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PREFACE 

This  report  presents  the  results  of  a  study  entitled  "The  Application 
of  Bi ocybernetic  Techniques  to  Enhance  Pilot  Performance  During  Tactical 
Missions."  The  research  was  conducted  by  the  McDonnell  Douglas  Astronautics 
Company-St.  Louis  Division  for  tiie  Defense  Advanced  Research  Projects  Agency 
(DARPA)  under  contract  MDA-903-78-C-0181.  The  preparation  of  a  second 
document  -  "Proceedings  of  the  DARPA  Conference  on  Biocybernetic  Applications 
for  Military  Systems,"  Chicago,  April  1978  -  also  was  supported  by  this 
contract. 

We  acknowledge  the  assistance  of  Dr.  Craig  I.  Fields,  Senior  Program 
Manager,  Cybernetics  Technology  Office  of  the  Defense  Advanced  Research 
Projects  Agency. 
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1.0  ABSTRACT 


This  report  describes  a  rather  novel  means  of  enhancing  man's  performance 
in  highly  complex,  crew  station  environments.  Specifically,  we  have  related 
the  benefits  of  on-line  evaluation  of  physiological  data  to  projected  mission 
requirements  for  a  1990  tactical  aircraft. 


The  salient  role  that  tactical  air  power  must  continue  to  play  in  the 
structure  of  U.S.  defense  forces  has  engendered  a  sophisticated  technological 
approach  to  weapon  system  development.  Therefore,  we  begin  with  an  overview 
of  the  components  of  a  "high  technology"  weapon  system  -  real-time  command 
and  control,  advanced  crew  station  and  avionics  design,  effective  defense 
suppression,  sensor  aided  target  acquisition,  and  precision-yuided  ordnance. 
Although  a  reliance  upon  advanced  technology  and  a  trend  toward  greater 
automation  of  aircraft  functions  are  clearly  evident,  the  importance  of  the 
human  element  should  not  be  underestimated.  This  is  especially  true  if  the 
system  is  to  retain  the  capacity  to  anticipate  and  respond  to  unpredictable 
threats.  Herein  lies  the  present  dilemma.  Man-i n-the-1 oop  assures  that 
tactical  aircraft  will  have  an  inherent  flexibility.  However,  if  man  is 
unable  to  perform  increasingly  complex  tasks  both  rapidly  ana  accurately 
under  all  combat  situations,  he  may  severely  limit,  and  perhaps  even  under¬ 
mine,  the  inventive  technology  of  the  system  he  controls. 


It  may  be  possible  to  solve  this  problem  by  taking  advantage  of  the  same 
improvements  in  digital  computation  and  signal  processing  that  currently 
influence  hardware  development.  .That  is,  we  may  enhance  the  pilot's  effec¬ 


tiveness  if  we  monitor  momentary  fluctuations  in  attentiveness  and  in  his 
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ability  to  process  information  and  make  appropriate  decisions.  The  report 

summarizes  research  which  has  demonstrated  that  these  mental  activities  are 
manifest  in  distinct  electrophysiological  signals,  and  that  such  signals, 
recorded  noninvasively  and  unobtrusively,  can  be  analyzed  and  interpreted  in 
real-time.  On  this  basis,  we  suggest  that  the  central  computer  onboard  the 
aircraft  may  be  able  to  determine: 

o  when  the  pilot  is  inattentive, 

o  when  visual  or  auditory  information  has  not  been  processed, 
o  when  the  pilot  is  task-loaded  to  the  extent  that  he  is  unable  to 
accept  additional  duties, 

o  when  the  pilot  lacks  confidence  in  a  decision  he  has  made. 

For  a  variety  of  mission  segments  we  then  outline  the  courses  of  action  which 
can  be  taken  to  unburden  or  assist  the  pilot  if  biological  signal  processing 
has  forewarned  an  imminent  deterioration  in  his  capacity  to  perform.  The 
actions  include,  among  others: 

o  redistributing  task  responsibilities, 

o  reducing  the  complexity  of  or  "decl  uttering"  information  displays, 
especially  the  HUD, 

o  cueing  the  pilot  to  attend  to  critical  flight,  weapons,  and  target 
data, 

o  displaying  adaptive  decision  aids  which  present  weighted  recommen¬ 
dations  for  mission-related  strategies,  particularly  with  respect  to 
fire  control  functions, 
o  furnishing  remedial  "checklists," 

o  optimizing  the  physical  characteristics  (e.g.,  contrast,  focus,  etc.) 
of  imagery  and  symbolic  presentations. 
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The  recording  and  analysis  of  electrophysiological  data  also  may  permit 

a  direct  coupling  of  the  pilot  with  aircraft  subsystems  from  a  control 
standpoint.  At  issue  is  whether  it  will  be  possible  to  interpret  bioelectric 
patterns  related  to  different  thought  commands,  whereby  the  pilot  can  "think" 
to  activate  control  surfaces. 

We  are  aware  that  a  great  deal  more  must  be  accomplished  (in  computer 
technology,  software  development,  and  the  design  of  physiological  monitoring 
equipment)  before  it  is  both  feasible  and  practical  to  apply  biocybernetic 
techniques  in  dynamic,  operational  environments.  Nonethel  ess,  we  have 
attempted  to  clarify  important  basic  research  issues  and  to  recommend  reason¬ 
able  priorities  for  future  investigations. 
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2.0  INTRODUCTION 


Generally  stated,  our  purpose  has  been  to  assess  the  impact  of  applying 
biocybernetic^  techniques  to  improve  human  performance  and  thus  enhance 
system  effectiveness.  We  have  made  several  assumptions  in  undertaking  this 
assessement. 

o  The  human  operator  is  and  will  remain  an  integral  component  of 
evolving  computer-based  systems. 

o  These  advanced  systems  will  be  adaptive,  that  is,  the  distribution  of 
responsibilities  between  the  operator  and  the  system  will  be  modified 
as  circumstances  change. 

The  computer-based  system  with  which  we  are  concerned  is  a  generic 
tactical  aircraft,  and  the  human  operator  in  this  instance  is  more  commonly 
referred  to  as  a  pilot.  With  respect  to  the  data  requirements  for  imple¬ 
menting  adaptive  procedures,  we  find  that  digital  avionics  programs  within 
the  Air  Force  and  Navy  are  providing  the  means  for  a  reliable  and  efficient 
flow  of  information  about  the  current  status  of  aircraft  subsystems.  Via 
external  sensing,  the  pilot  also  will  be  apprised  of  the  changing  posture  of 
the  mission. 


^  The  term  denotes  a  real-time  communication  link  between  a  human  operator 
and  the  system  he  controls,  that  is  based  upon  the  physiological  activity 
which  is  recorded  as  the  operator  performs  assigned  tasks. 
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Rapidly  occurring  developments  in  digital  computation,  data-busing, 

electronic  circuitry,  display  generation,  and  input/output  technology  have 
created  a  trend  toward  greater  automation.  This  will  reduce  the  extent  to 
which  the  pilot  participates  in  housekeeping  functions  (i.e.,  navigation, 
subsystems  monitoring,  communications,  and  aircraft  control),  thereby  allow¬ 
ing  him  to  attend  more  closely  to  mission-related  activities  (i.e.,  detec¬ 
tion,  location,  identification,  decision,  execution,  and  assessment).  The 
pilot  will,  of  course,  play  a  direct  role  in  any  housekeeping  function  if 
alerted  of  a  subsystem  failure. 

While  the  communication  link  from  subsystem  to  computer  is  impressive 
indeed,  we  may  ask  whether  comparable  means  are  available  for  the  pilot  to 
convey  status  information  to  the  computer.  Status  in  this  context  refers  to 
momentary  fluctuations  in  attentiveness  or  in  the  ability  to  process  infor¬ 
mation  and  make  appropriate  decisions.  An  operator  usually  communicates  with 
a  computer  via  manual  responses  or  perhaps  a  small  vocabulary  of  verbal 
responses.  It  is  unlikely  that  these  inputs  are  sufficiently  sensitive  to 
the  types  of  momentary  fluctuations  mentioned  above.  And  even  if  overt 
behavioral  measures  could  provide  such  information,  the  process  of  supplying 
it  on  demand  might  prove  extremely  disruptive  to  critical  mission-related 
tasks. 

The  program  of  biocybernetics  research  sponsored  by  DARPA  since  1974 
has  attempted  to  alleviate  the  imbalance  in  the  flow  of  status  information 
by  adding  a  communication  channel  from  the  operator  to  the  computer.  In 
describing  the  program,  Donchin  (1979)  states: 
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"A  channel  carrying  psychophysiological  data  (unobtrusively)  acquired 
from  the  operator  can  supply  the  adaptive  controller  with  at  least  part 
of  the  necessary  information.  The  program  thus  assumes  that  mental 
activities  manifest  themselves  in  a  variety  of  physiological  signals. 

It  further  assumes  that  it  is  possible  to  make  strong  inferences  about 
mental  activity  from  such  signals."  (p.  3) 

We  believe  that  the  virtue  of  this  communication  channel  is  not  limited 
to  the  conveyance  of  status  information  for  the  purpose  of  effecting  more  or 
less  automation.  Rather,  we  also  envisage,  among  other  applications,  a 
direct  coupling  of  the  pilot  to  aircraft  subsystems  from  a  control  stand¬ 
point,  such  as  through  "thought"  commands. 

In  this  report,  we  examine  whether  the  pilot's  ability  to  satisfy  tac¬ 
tical  mission  requirements  can  be  enhanced  if  electrophysiological  manifes¬ 
tations  of  brain  function  are  processed  by  the  central  computer.  We  discuss 
quick-reaction  situations,  where  the  crew  member  is  vulnerable  and  where 
performance  accuracy  or  the  speed  of  response  may  be  improved.  While  brain 
electrical  activity  is  emphasized,  we  consider  other  biological  signals  as 
well.  These  include  peripheral  psychophysiological  responses  and  aspects 
of  ocular  behavior. 

We  have  concentrated  on  pilot  tasks  associated  with  (a)  the  extraction 
of  displayed  information  and  auditory  messages,  (b)  decision-making  based 
upon  subsequent  processing  of  these  inputs,  and  (c)  control  activation. 
Moreover,  the  pilot  tasks  we  describe  in  detail  were  chosen  because  they  are 
very  difficult  and/or  are  critical  to  the  success  of  the  mission,  or  because 
they  occur  during  periods  of  high  workload. 
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The  next  section  of  the  report  summarizes  relevant  "ground  rules"  for 

biocybernetic  applications  in  a  1990  time  period.  As  describea  previously 
(Gomer  and  Youngling,  1978),  there  are  significant  technical  difficulties  to 
be  overcome  before  closed-loop  concepts  can  be  incorporated  in  operational 
settings.  We  feel  that  the  time  frame  which  has  been  adopted  is  reasonable, 
in  view  of  the  necessity  for  long-term  planning.  Sections  4  and  5  compare 
general  mission  requirements  for  the  principal  mission  types  and  outline  the 
information  needs  of  the  pilot,  respectively.  Three  major  subsections 
comprise  Section  6.  The  first  presents  time  line  analyses  of  pilot  tasks 
for  a  postulated  escort  mission.  This  is  followed  by  a  discussion  of  the 
particular  categories  of  biological  signals  which,  when  interpreted  by  the 
computer,  offer  the  most  promise  for  improving  task  performance.  Finally, 
biocybernetic  applications  are  presented  in  a  matrix  format  for  each  of 
thirteen  integrated  mission  segments.  Section  7  then  offers  conclusions  and 
recommendations. 
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3.0  AN  OVERVIEW  OF  MISSION  TYPES  AND  PROJECTED 
TECHNOLOGY  ADVANCES  FOR  TACTICAL  AIRCRAFT 


This  summary  information  is  intended  to  provide  a  framework  for  later 
discussions  of  pilot  tasks  and  potential  biocybernetic  applications. 

In  general ,  we  have  assumed  a  Central  European  Theatre  (CET),  and  this 
has  influenced  mission  requirements,  projected  weapons,  and  aircrew  func¬ 
tions.  We  also  have  recognized  the  trend  toward  one-man  aircraft,  due  to 
reduced  procurement,  operating,  and  training  costs,  and  the  fact  that  fewer 
personnel  are  exposed  to  combat.  We  assume  that  vehicle  characteristics  will 
be  typical  of  a  two  engine  high  performance  aircraft  (perhaps  with  direct 
force  flight  control).  Ordnance  should  consist  principally  of  stand-off  type 

3 

weapons,  and  command,  control,  and  communication  (C  )  should  encompass: 
Airborne  Warning  and  Control  Systems  (AWACS),  Global  Positioning  Satellite 
(GPS),  and  Joint  Tactical  Information  Distribution  System  ( JT IDS ). 

We  believe  that  advanced  crew  stations  will  be  developed  with  a  concern 
for  efficient  information  flow  between  the  pilot  and  the  various  aircraft 
subsystems  (cf.  Mills  et  al.,  1978  ).  Figures  3.1  and  3.2  i  1  lustrate  the 
essential  elements  of  such  a  crew  station.  Included  will  be: 

(1)  Vertical  Situation  Display  (VSD)  -  presents  attitude  and  position 
information  in  the  vertical  plane,  also  predictive  or  command 
symbology  for  all  flight  phases, 

(2)  Horizontal  Situation  Display  (HSD)  -  provides  geographic  information 
in  the  form  of  terrain  images,  computer  generated  navigational 
maps  and  supporting  symbology,  and  tactics, 
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FIGURE  3.1  INTEGRATED  CREW  STATION  CONCEPT  FOR  A 
1990  TACTICAL  AIRCRAFT. 
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1.  Head  Up  Display 

2.  Head  Up  Display  Camera 

3.  Threat  Alert 

4.  Canopy  Alert 

5.  CNI/ECM/HUO  Control 

6.  Digital  Clock 

7.  R/H  Engine  Fire  Alert  and  Extinguisher  Button 

8.  Radio  Call  Number 

9.  Back  Up  Display  Select  Panel 

10.  Multimode  Display  No.  2 

1 1.  Takeoff  Check  List  and  Spare 

12.  Spare  Panel 

11  Caution  and  Advisory  Panel 

14.  Hydraulic  Pressure 

15.  Vertical  Situation  Oisplay/Tactical  Display 
(Multimode) 

16.  Armament  Station  Salect/Selective  Jettison  Panel 

17.  Horizontal  Situation  Display  and  Moving  Map 
(Multimode) 

FIGURE  3.2  DESCRIPTIONS  OF  THE  INSTRUMENTS  DEPICTED 
IN  FIGURE  3.1. 
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18.  Jet  Fuel  Starter 

19.  Rudder  Pedal  Adjustment 

20.  Emergency  Brake 

21.  Multimode  Display  No.  1 

22.  Surface  Position  Indicators  (Ref) 

23.  Fuel  Quantity  Panel  (Ref) 

24.  Critical  Engine  Status  (Ref) 

25.  Oil  and  Pneumatic  Pressure 

26.  Landing  Gear  Position  Indicator 

27.  Gear  All  Stores  Emergency  Jettison 

28.  Landing  Check  List  and  Spare 

29.  Mode  Advisory  Panel 

30.  L/H  Engine  Fire  Alert  and  Extinguisher  Button 

31 .  Armament  Master  Arm  Switch 

32.  Landing  Gear  Alert 

33.  Fire  Extinguisher  Arm  Switch 

34.  Master  Caution 
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(3)  Multipurpose  Displays  (MPDs)  -  present  system  malfunctions  auto¬ 
matically;  operator  selects  via  keyboard  the  information  he  desires 
(e.g.,  engine  parameters,  flight  checklists,  target  designations, 
weapons  status,  sensor  FOV,  etc.), 

(4)  Head-Up  Display  (HUD)  -  presents  weapons  delivery  and  flight 
information,  also  limited  video, 

(5)  Helmet-Mounted  Display  (HMD)  -  a  virtual  image  display  (as  is  the 
HUD)  which  also  presents  weapons  delivery  and  flight  information; 
however,  it  obviates  the  usual  requirement  of  a  fixed  display 
location, 

(6)  Multifunction  Control  Unit  (MFCU)  -  allows  the  pilot  to  sequence 
display  presentations  via  keyboard  inputs, 

(7)  Hands-On-Throttl  e-And-Stick  (HOTAS)  Controls  -  fly-by-wire,  with 
critical  subsystem  (particularly  weapons)  controls  integrated 
directly  into  the  stick  and  throttle. 

Growing  alarm  over  the  task  demands  imposed  on  the  pilot  and  severe 
space  limitations  within  the  crew  stations  of  existing  tactical  aircraft  have 
forced  engineers  to  discard  a  design  philosophy  which  prescribes  the  use  of 
dedicated,  single-purpose  instruments.  An  accelerated  obsolescence  of  this 
conventional  approach  to  crew  station  design  and  a  new  emphasis  on  multi¬ 
purpose  displays  and  keyboards  have  been  brought  about  by  remarkable  develop¬ 
ments  in  two  areas:  digital  avionics  and  programmable  electronic  display 
devices.  Large  scale  integration  (LSI)  technology  has  produced  the  necessary 
microcircuit/  microprocessor  electronics  to  create  an  extremely  flexible 
display  generation  capability.  Raster-scan  graphics  can  be  used  to  generate 
realistic  and  varied  synthetic  visual  scenes,  and  they  afford  an  ease  of 
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mixing  display  symbology  with  the  outputs  of  imaging  sensors  such  as  radar, 

low-light-level  TV,  and  forward  looking  infrared.  Display  presentations  can 
be  limited  (in  theory)  to  those  sources  of  information  which  are  most  relevant 
at  a  specific  time  period  in  the  mission.  Moreover,  the  sequencing  of 
presentations  can  be  controlled  by  the  particular  computer  program(s)  in 
operation  and  by  the  crew  member's  keyboard  inputs. 

While  numerous  display  developments  are  in  progress  that  offer  great 
promise  for  the  1990  time  frame  we  have  adopted,  the  cathode  ray  tube  (CRT) 
in  all  likelihood  will  remain  preeminent.  It  has  a  superb  capability  for 
presenting  almost  unlimited  formats  (including  video). 

3.1  MISSION  TYPES 

Tactical  Air  Power  (TACAIR)  recognizes  three  primary  missions  to  accom¬ 
plish  the  objective  of  successfully  waging  war.  The  missions  are  Close  Air 
Support  (CAS),  Air  Interdiction  (AI),  and  Counter  Air  (CA).  Although  there 
are  other  TACAIR  missions,  such  as  Reconnaissance  and  Electronic  Warfare, 
they  generally  are  conceived  to  be  supportive  of  offensive  air-to-air  and 
air-to-ground  missions.  Mission  definitions  are  as  follows: 

Close  Air  Support  -  Air  action  against  hostile  ground  targets  that  are 
in  close  proximity  to  friendly  ground  forces.  This  requires  detailed 
integration  of  each  air  mission  with  the  battle  activities  and  movements 
of  those  forces. 
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Air  Interdiction  -  Air  operations  conducted  to  destroy,  neutralize  or 

delay  the  enemy's  military  potential  before  it  can  be  brought  to  bear 
against  friendly  forces.  These  operations  are  conducted  at  such  dis¬ 
tances  from  friendly  forces  that  detailed  integration  of  air  and  ground 
activities  is  not  required. 

Counter  Ai  r  -  Air  operations  conducted  to  attain  or  maintain  a  desired 
degree  of  air  superiority  by  the  destruction  or  neutralization  of  enemy 
air  forces.  Both  offensive  and  defensive  air  actions  are  involved. 
Offensive  actions  range  throughout  enemy  territory  and  generally  are 
conducted  at  the  initiative  of  the  friendly  forces.  Defensive  operations 
are  conducted  near  to  or  over  friendly  territory  and  usually  are  reactive 
to  the  initiative  of  the  enemy  air  forces. 

Figure  3.3  summarizes  the  scope  of  TACAIR’s  three  primary  missions. 
Obviously,  a  large  number  of  mission  profiles  will  emerge  for  each  mission 
type,  given  the  unpredictable  nature  of  enemy  operations  and  the  broad  range 

3 

of  weapons,  sensors,  and  C  systems  employed  by  friendly  air  forces.  Conse¬ 
quently,  comprehensive  yet  representative  profiles  were  developed  for  the 
three  ini ssions. 

We  have  chosen  to  concentrate  on  the  basic  elements  of  each  mission  and 
to  avoid  excessive  concern  for  mission  details  that  infrequently  impact 
aircrew  tasks.  For  example,  a  pilot  does  not  particularly  care  whether  he 
penetrates  at  0.85  or  0.92  Mach,  at  25,000  or  29,000  ft,  or  whether  he  pulls 
6.2  or  7.1  g's.  These  are  operational  techniques  that  take  advantage  of 
particular  design  features  and  overall  aircraft  performance.  Once  a  pilot  is 
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FIGURE  3.3  PICTORIAL  REPRESENTATION  OF  THE  THREE 
TACAIR  MISSIONS. 
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thoroughly  familiar  with  an  aircraft  he  usually  develops  "rules  of  thumb"  to 

cover  the  situations  most  commonly  encountered.  A  pilot  frequently  will  fly 
mission  segments,  such  as  low  level  routes,  at  airspeeds  which  are  even 
tenths  of  a  Mach  (0.7,  0.8,  or  0.9)  or  multiples  of  60  knots  (420,  480,  540). 

This  is  done  in  lieu  of  best  cruise  or  other  optimum  speeds  because  it 
facilitates  solving  in-flight  timing  problems,  an  important  parameter  in  all 
offensive  air  missions. 

The  previous  example  illustrated  that  mission  timing  can  be  more  impor¬ 
tant  than  optimum  penetration  speed.  Many  other  examples  are  possible  that 
would  further  contrast  pilot  and  aircraft  design  priorities.  The  mission 
profiles  that  follow  emphasize  the  pilot  priorities,  especially  in  terms  of 
decision-making  functions  and  information  needs. 

General  mission  requirements  are  identified  in  Figure  3.4  for  pre-flight, 
in-flight,  and  post-flight  phases.  Representative  mission  profiles  were 
constructed  from  these  requirements  and  are  illustrated  in  Figures  3.5 
through  3.7  for  Close  Air  Support,  Air  Interdiction,  and  Counter  Air  missions, 
respectively.  A  detailed  comparison  of  mission  requirements  for  the  three 
mission  types  is  presented  in  Section  4.0. 

Although  we  have  considered  the  mission  requirements  individually,  they 
overlap  significantly  in  operational  situations. 
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1.  Pre-Flight  -  All  aircrew  functions  leading  up  to  and  Including  takeoff. 

1.1  Mission  Planning 

1.2  Preflight 

1.3  Start  and  System  Checks 

1.4  Taxi 

1.5  Arming 

1.6  Takeoff 


2.  In-Flight  -  All  flight  activities  beginning  with  climb  and  concluding  at 
the  termination  of  the  landing  roll. 

2.1  Climb  to  Level -Off 

2.2  Cruise 

2.3  Loiter 

2.4  Rendezvous  and  Air-to-Air  Refueling  (AAR) 

2.5  Coordination 

2.6  Mission  Rendezvous 

2.7  Penetration 

2.8  Threat  Warning 

2.9  Detection 

2.10  Location 

2.11  Identification 

2.12  Decision 

2.13  Execution 

2.14  Assessment 

2.15  Termination 

2.16  Egress 

2.17  Cruise 

2.18  Rendezvous  and  Air-to-Air  Refueling  (AAR) 

2.19  Reengage 

2.20  Return  to  Base 

2.21  Descent 

2.22  Approach 

2.23  Landing 

3.  Post-Flight  -  All  mission-related  activities  beginning  after  the  completion 
of  the  landing  roll  and  ending  when  the  aircrew  is  free  to  perform  other 
duties  or  pursue  personal  Interests. 

3.1  De-arm 

3.2  Taxi 

3.3  System  Checks 

3.4  Shutdown 

3.5  Post-Flight 

3.6  Debrief 


FIGURE  3.4  GENERAL  MISSION  REQUIREMENTS  FOR  PRE-FLIGHT, 
IN-FLIGHT,  AND  POST-FLIGHT  PHASES. 
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Debriefing  1.  Parentheses  indicate  optional  phases. 

2.  Numbers  refer  to  phase  of  flight  and  mission  requirement. 


FIGURE  3.5  MISSION  PROFILE  FOR  CLOSE  AIR  SUPPORT. 
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Debriefing 


2.  Numbers  refer  to  phase  of  flight  and  mission  requirement. 


FIGURE  3.6  MISSION  PROFILE  FOR  AIR  INTERDICTION. 
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Debriefing  1.  Parentheses  indicate  optional  phases. 

2.  Numbers  refer  to  phase  of  flight  and  mission  requirement. 


FIGURE  3.7  MISSION  PROFILE  FOR  COUNTER  AIR. 
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3.2  TECHNOLOGY  ADVANCES 

3.2.1  Weapons  -  The  CET's  defenses,  weather,  terrain,  and  target 
characteristics  (size,  mobility,  signature)  compromise  the  effectiveness  of 
many  weapons  which  currently  are  operational  (cf.  Levine,  Beideman,  and 
Youngling,  1978).  Therefore,  new  concepts  are  needed.  Stand-off  weapons, 
both  unitary  and  dispenser  types,  with  midcourse  and  terminal  guidance  offer 
one  of  the  most  feasible  solutions.  Figure  3.8  summarizes  the  characteristics 
of  various  guidance  options.  These  guidance  systems  also  can  be  used  in 
combination.  For  example,  midcourse  guidance  can  be  inertial  while  terminal 
guidance  can  be  imaging  infrared  (IIR)  with  data  link  lock-on. 

It  is  important  to  emphasize  that  the  key  features  of  future  weapons 
are  that  they  be  stand-off  and  that  they  possess  accurate  guidance  and 
control.  The  net  results  are  to  increase  survivability  and  effectiveness  and 
to  reduce  losses  and  the  resources  required  to  destroy  a  target. 

Figure  3.9  defines  the  various  air-to-air  missiles  that  influence  pilot 
tasks.  The  physical  characteristics  are  listed,  as  are  the  system  components 
associated  with  a  successful  missile  deployment.  Important  to  the  crew 
station  designer  are  the  cockpit  components  that  are  required  to  launch  each 
missile.  The  basic  purpose  of  each  missile  has  been  provided  in  the  "Remarks" 
column. 

Figures  3.10  and  3.11  present  similar  information  for  air-to-surface 
ballistic  weapons  and  air-to-surface  missiles,  respectively. 
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Characteristics 

Generic 

Guidance 

Type 

Adverse 

Weather 

Fixed 

Targets 

Moving 

Targets 

• 

LOBL 

•  * 
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Launch 

and 

Leave 

Laser  Seeker 

- 

V 

V 

V 

/ 

V 

- 

EO  Tracker 

(Edge,  Centroid,  Correlation) 

v/ 

V 

V 

V 

Lock  On  Before  Launch 

— 

— 

Data  Link  Lock  On 

— 

V 

sj 

V 

V 

HR  Tracker 

(Edge,  Centroid.  Correlation) 

V 

s/ 

Lock  On  Before  Launch 

— 

V 

— 

y/ 

Data  Link  Lock  On 

- 

y/ 

y/ 

V 

V 

IR/Radiometric  Seekers  (Passive) 

\/ 

v' 

V 

V 

V 

Radar 
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V' 

V 

V 

V 

V 

V 

SAR  Line  of  Sight 

V 

y/ 

v/ 

yj 
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V 

V 

V 

— 

sj 

— 
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V 

V 

V 

V 

y/ 
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V 

V 

V 

V 

V 
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V' 

V 

V 

v/ 

y/ 
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V 

V 

V 

n/ 
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V 

V 

V 

V 

V 
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••Lock-on  after  launch 


FIGURE  3.8  GUIDANCE  SYSTEMS  AND  THEIR  CHARACTERISTICS. 
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FIGURE  3.9  TYPES  OF  AIR-TO-AIR  MISSILES. 
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3.2.2  Avionics  -  The  reduction  in  the  cost  of  digital  circuitry  and  the 

advantages  of  expandable  memory  are  responsible  for  an  increase  in  the  use  of 
digital  computers  onboard  military  aircraft.  Most  importantly,  the  avionics 
are  more  integrated,  with  the  various  subsystems  under  the  control  of  higher 
level  systems  which,  in  turn,  are  under  the  control  of  the  pilot.  By  effec¬ 
tive  interconnection  of  subsystems  workload  can  be  reduced,  permitting  the 
pilot  to  concentrate  on  those  tasks  which  the  central  computer  cannot  handle 
effectively. 

The  advances  in  electronics  will  result  in  more  accurate  navigation, 
improved  night  and  adverse  weather  target  detection,  jam  resistant  communica¬ 
tions,  and  more  effective  countermeasures.  The  largest  payoff  may  be  in 
terms  of  better  command,  control  and  communication  (C  )  systems.  The  pro¬ 
grams  most  likely  to  affect  aircraft  systems  and  crew  information  require¬ 
ments  are  the  Joint  Tactical  Information  Distribution  System  ( JT  IDS )  and  the 

3 

Airborne  Warning  and  Control  System  (AWACS).  Although  not  directly  a  C 
program,  the  Global  Positioning  System  (GPS)  may  interface  with  JTIDS  for 
navigation  and  blind  navigation  bombing  purposes. 

A  summary  of  anticipated  avionics  improvements  is  shown  in  Figure  3.12, 
with  reference  to  the  Air  Force  Digital  Avionics  Information  System  (DAIS). 

3.2.2. 1  Sensors  -  The  information  which  is  displayed  during  various 
phases  of  the  mission  is  derived  from  two  sources:  (a)  real-time  sensors  and 
(b)  the  a  priori  data  base  stored  in  the  aircraft  computers  before  takeoff. 

In  general,  those  data  which  are  retrieved  assist  the  pilot  in  performing 

monitoring,  navigation,  threat  location,  and  target  acquisition  functions. 

25 


MCDOWWLL  OOUOLM  4>TI?OW4UriC«  COMMMI'-tr.LOIM  DfVIWOW 


1  OCTOBER  1979 


BIOCYBERNETICS  AND  PILOT  PERFORMANCE 


MDC  E2046 


Function 

Equipment  Type 

Anticipated  Advances 

NAV 

Inertial 

Strapdown;  improved  gimballed  systems 

ADC 

Computations  performed  in  processor 

TACAN,  ILS,  ADF 

Weight,  size,  power  consumption 

GPS.  OMEGA 

Will  become  operational 

Hybrids 

GPS/inertial  available 

COM 

MSI,  LSI;  Shared  Antenna  ;  Modulation 
techniques 

JTIDS 

Will  become  operational 

IFF 

Improved  performance,  cost  reductions 

ECM 

Power  management 

Air/Ground  Attack 

Lasers 

Laser  target  seekers  will  become 
operational 

FLIP 

Reduced  costs,  weight,  size;  improved 
display 

FLR 

Improved  performance,  reliability 

C/D 

Controls  4  Displays 

Current  displays  and  controls  will  be 
replaced  by  compucer-driven  MPD 
plus  IMFK 

Processing 

Processors 

LSI  technology  and  microprocessors 
with  large  central  processing  capa¬ 
bility 

BITE  contained  within  microprocessors 

MOS  (metal  oxide  semiconductors) 

Bipolar  Schottky  transistor-transistor 
logic 

Power  Supply 

Central  power  supply  core  element 

Interface  Equipment 

BCIU,  RTO 

Integrated  within  sensor  or  processor 

FIGURE  3.12  ANTICIPATED  AVIONICS  ADVANCES  (WITH  REFERENCE 
TO  DAIS). 


26 


mcoonmll  oouola*  AmrmoMAVTicm  comtfAMv -mr  LCHJtm  ofwsfow 


1  OCTOBER  1979 


BIOCYBERNETICS  AND  PILOT  PERFORMANCE 


MDC  E2046 

The  sensors,  on  the  other  hand,  provide  essential  infonnation  for  all  house¬ 
keeping  and  mission-related  functions,  particularly  navigation,  communication, 
threat  detection/  location,  and  the  execution  of  air-to-air  or  air-to-ground 
attack. 

Representative  sensors  onboard  the  aircraft  include: 

o  multimode  radar  and  forward  looking  EO  or  IR  sensors  for  target 
recognition;  laser  designator/ranger/tracker  for  attack, 
o  imaging  seekers  for  missile  guidance  (see  Figure  3.8)  (implied  is  the 
dedicated  fire  control  computer  for  directing  these  seekers  to  the 
aimpoint  coordinates  available  from  the  target  acquisition  sensors), 
o  navigational  sensors  for  INS,  TACAN,  and  GPS, 

o  radar  and  laser  threat  (ground  and  air)  warning  sensors,  IFF  threat 
identification  receivers,  and  data-link  receivers  (e.g.,  JTIDS). 

We  should  mention  that  a  more  inclusive  listing  would  encompass  the  feedback 
devices  which  are  used  to  monitor  the  status  of  the  various  aircraft  sub¬ 
systems.  By  restricting  our  focus  to  those  baseline  sensors  listed  above, 
however,  we  can  describe  their  characteri sties  in  greater  detail  (see  Figure 
3.13). 

3. 2. 2. 2  Electronic  Displays  -  In  the  next  two  sections  (4  and  5)  of 
this  report,  the  mission  requirements  and  the  associated  infonnation  needs  of 
the  pilot  are  described  for  the  reader.  These  sections  demonstrate  that 
flexibility  in  display  generation  is  essential  to  satisfy  future  mission 
objectives.  The  pilot  must  be  able  to  select,  or  be  provided  automatically, 
integrated  information  which  is  updated  or  changed  accordingly  across  specific 
time  periods  in  the  mission. 
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We  stated  earlier  that  flexibility  is  afforded,  in  part,  by  the  incorpor¬ 
ation  of  multifunction  display  techniques.  Our  purpose  in  this  subsection  is 
to  present  a  brief  comparison  of  those  electronic  display  media  which  will  be 
competing  for  inclusion  in  tactical  crew  stations  during  the  1990s.  Recall 
that  Figures  3.1  and  3.2  illustrated  the  display  units  which  will  present 
visual  information  to  the  pilot.  They  consisted  of: 
o  Multipurpose  Displays  (MPDs), 
o  Horizontal  Situation  Display  (HSD), 
o  Vertical  Situation  Display  (VSD), 
o  Head-Up  Display  (HUD), 
o  Helmet-Mounted  Display  (HMD). 

Presentation  media  for  alpha  numerics,  symbolic  characters,  graphics,  and 
full  video  should  include: 

o  Cathode  Ray  Tubes  (CRTs), 
o  Liquid  Crystals  (LCs), 
o  Plasma  Devices  (PLDs), 
o  Light  Emitting  Diodes  (LEDs), 
o  Electroluminescence  Devices  (ELs), 
o  Laser  Displays  (LDs), 
o  Electromechanical  Devices  (EMDs). 

To  allow  a  meaningful  comparison  of  these  display  devices,  consider  the 
information  formats  and  coding  rchemes  (Figure  3.14)  with  respect  to  which 
the  competing  technologies  will  be  assessed  (see  Figure  3.15).  Other  factors 
certainly  must  be  taken  into  account  when  establishing  evaluation  criteria, 
and  these  are  illustrated  selectively  in  Figure  3.16. 
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A  -  On-off:  legend 

B  -  Alpha  numerics:  fixed  alphabet 

Cl  -  Characters  (symbols  and  alpha  numerics),  raster  or  matrix 
generated:  variable  alphabet 

C2  -  Characters,  stroke  generated:  variable  alphabet 

D  -  Graphics  and  characters:  fixed  format  and  alphabet 

El  -  Graphics  and  characters,  raster  or  matrix  generated: 
variable  format  and  alphabet 

E2  -  Graphics  and  characters,  stroke  generated:  variable  format 
and  alphabet 

F  -  Full  video  (or  fixed  image) 

G  -  Color  coding 

H  -  Size  coding 

I  -  Depth  coding 

J  -  Time  coding  (typically  a  software  problem) 


FIGURE  3.14  INFORMATION  FORMATS  AND  DISPLAY  CODING  SCHEMES. 
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DISPLAY  TECHNOLOGIES 


DISPLAY 

FORMAT 

TYPES 

(SEE  FIGURE 
3.14) 


LD 

EMD 

EL 

LED 

PLD 

LC 

CRT 
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X 

X 

X 

X 

X 

X 
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X 

X 

X 

X 

X 

X 

X 

C1 

X 

X 

X 

X 

X 

C2 

X 

D 

X 

X 

X 

X 

X 

X 

E1  • 

X 

X 

X 

X 

X 

E2 

X 

X 

F 

X 

? 

? 

X 

X 

G 

X 

X 

X 

? 

? 

? 

H 

X 

? 

X 

X 

X 

X 

X 

I 

J 

X 

? 

X 

X 

X 

X 

X 

FIGURE  3.15  COMPARISON  OF  DISPLAY  TECHNOLOGIES,  WITH  RESPECT 
TO  INFORMATION  FORMATS  AND  CODING  SCHEMES. 
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PARAMETER 

PLASMA  PANEL 

Mi  1 

LIQUID 

CRYSTAL 

CRT 

Resolution 

30-60  epi 

20-50  eoi.  large  panels 
500  epi ,  small  panels 

30-50  epi 

100  epi ,  large  panels 
588  epi,  small  panels 

120-1600  epi 

Brightness 

>30-50  ft  L 

>30  ft  L 

.100  ft  L  . 

Ambient  OeDendent 

.30-1000  ft  L 

Contrast 

2,20:1  Binary 

^10:1  Full  Video 

100:1 

20:1  Full  Video 

20:1  Full  V i aeo 

Oisplay  Size 

<1024  elements 

T7  inch  sq 
(ac  driven) 

240  elements.  6  inch 

500  elements,  1  inch 

250  elements, 

6  in.  sg. 

350  elements,  3.5  in. 
600  elements,  1  in. 

480-830  elements 
1-25  inch  sq. 

Color 

Primarily  Neon 
Orange  Full 

Color  Possible 

Phosphor  Dependent 

Full  Color  Possible 

Red;  green  and 
yellow  also 
available 

Primary  Black/White 
but  Contrasting 

Colors  are  Available 

Phosphor 

Depend ent, 
Oiscrete  Colors 
Also 

Power 

Requirements 

200-300W 

low 

1 ,5-2.0W/cm2 
01.5-2.0  volts 

5„w/cm2  to  1.0  mW/cm^ 
@3-15  volts 

100  watts 

Thickness 

<1  inch 

<1  inch 

<1  inch 

<1  inch 

=12-18  inch 

Height 

50  lbs 

- 

- 

Up  to  50  Lbs. 

Environment 

Rugged 

Rugged 

Rugged 

Rugged  but  Tempera¬ 
ture  Limits 

Rugged  1  zed 

Aspect 

Viewing 

Wide  Aspect 

Uniform,  Wide  Aspect 

Slight  Gain  8ut 
Basically  Uniform 

Restricted 

Uniform  Wide 

Time  Constants 

Std.  Video 
(dc  driven) 

Compatible  With  Std. 
Video 

Compatible  With 
Std.  Video 

10-500  rns  (with  scan 
converter  1C  can 
display  std.  video) 

3-lOMHz  Std. 

Video 

Storage/ 

Refresh 

yes  (ac  driven) 
no  (dc  driven) 

Yes,  but  is  config¬ 
uration  dependent 

No 

Limited  Storage 

None  (storage 

CRTs  are 
available) 

Rel  iabi  1  i  t>/ 
Malntainabi i 1 ty 

100.000  hrs  LRU 

1.000  to  10,000  hrs. 

LP.U 

10,000  to  100,000 
hrs,  LRU 

20,000  hrs,  LRU 

15  to  15,000  hrs. 
LRU 

Status 

Operational/ 
Coitwercial  !y 
Available 

Laboratory  Demonstra¬ 
tion  Models 

Commercially 

Available/ 

Operational 

Operational/Labor¬ 
atory  Demonstration 
Models 

Operational 

FIGURE  3.16  EVALUATION  PARAMETERS  AND  CORRESPONDING 
PERFORMANCES  OF  SELECTED  DISPLAY  DEVICES. 
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The  CRT  will  probably  remain  the  fundamental  display  medium  in  the 

1990s,  because  of  its  versatility  in  generating  data  for  all  display  units 
listed  above  (i.e.,  MPD,  HSD,  VSD,  HUD,  HMD).  However,  as  new  display  media 
are  developed  (e.y.,  electrophoretic,  magnetic  particle,  and  el ectrochroinatic 
devices)  the  pilot's  information  needs,  which  translate  to  display  formats 
and  codes,  must  be  considered  as  the  most  significant  evaluation  criterion. 

3. 2. 2. 3  Multifunction  Control  Unit  -  Multifunction  switches,  a  rela¬ 
tively  new  concept  in  control  technology  (see  Figure  3.1),  are  a  counter¬ 
part  of  computer  generated  multifunction  displays.  They  may  be  thought 
of  as  versatile  sets  of  switch  contacts  which  perform  different  switching 
operations. 

Each  switch  within  a  iu u 1 1 i function  control  unit  addresses  computer 
logic,  which  determines  the  specific  function  of  that  switch  and  initiates 
the  desired  action  when  the  control  surface  is  activitated.  Since  the 
function  of  a  particular  switch  changes,  current  status  of  the  switch  must  be 
displayed.  There  are  several  ways  in  which  this  can  be  accomplished: 

o  rear  projecting  legends  onto  pushbutton  switches, 

o  generating  legends  remotely  and  transmitting  to  switch  face  with 
fiber  optics, 

o  generating  legends  on  an  electronic  display  with  switches  located  in 
the  periphery, 

o  generating  legends  on  an  electronic  display  and  then  activating  the 
area  which  has  been  designated  (touch,  light  pen,  photo-sensiti ve 
detectors,  etc.), 

o  generating  legends  directly  on  the  switch  face. 
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3.2. 2. 4  Voice  Actuated  Controls  -  As  modern  aircraft  become  increasingly 
more  sophisticated,  additional  responsibilities  are  created  which  add  to  an 
already  burdensome  pilot  workload.  The  concept  of  voice  actuated  systems 
(VAS)  is  one  potential  solution  to  this  problem.  In  fact,  the  applications 
can  be  extended  in  principle  to  incorporate  “thought"  commands,  as  discussed 
in  Subsection  6.3. 

The  purpose  of  VAS  is  to  permit  more  direct  communication  with  the 
computer,  thereby  alleviating  conventional  workload  and  providing  additional 
time  to  perform  higher  level  tasks. 

The  particularly  desirable  features  of  VAS  are:  a  reduction  in  manual 
control  procedures  (especially  during  critical  fliyht  phases),  a  reduction  in 
eye-hand  coordination  problems,  and  a  reduction  in  visual  demands  inside  the 
cockpit.  A  representati ve  application  may  be  found  in  weapons  delivery. 
During  this  mission  phase,  the  pilot  is  concerned  with  the  sequence  of  events 
necessary  to  properly  arm  and  deliver  weapons  on  a  target,  to  maintain 
altitude  and  airspeed  within  acceptable  limits,  to  perform  required  communica¬ 
tions,  and  to  remain  alert  for  enemy  threats.  With  VAS,  it  may  be  possible 
for  the  pilot  to  change  radio  channels  and  to  arm  and  deliver  weapons  by 
simple  voice  commands.  Hence,  more  time  and  attention  can  be  given  to  target 
acquisition,  lock-on,  flight  control  and  threat  avoidance. 

Voice  data  entry  systems  are  already  in  use  for  a  number  of  interactive 
command  and  control  functions.  However,  these  systems  have  a  limited  vocab¬ 
ulary  and  are  speaker  specific.  Vocabularies  typically  consist  of  digits  and 
a  small  set  of  control  words  and  phrases. 
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3. 2. 2. 5  Joint  Tactical  Information  Distribution  System  (JTIDS)  -  JTIUS 

is  a  digital  communication  system  for  secure,  real-time  command  and  control 
of  combat  operations.  JTIDS  will  interconnect  the  tactical  defense  elements 
of  all  services  with  survei  11  ance/ intel  legence  centers  and  with  command  and 
control  centers  in  the  theatre  of  operations.  Precise  time-of-arri val 
measurements ,  coupled  with  the  transmission  of  emitter  location,  are  used  to 
generate  a  common  grid  coordinate  system  containing  the  location  of  all 
active  net  participants.  The  system  uses  Time  Division  Multiple  Access 
(TDMA)  to  interconnect  all  users  via  one  common  channel  for  the  distribution 
of  information.  Each  authorized  element  is  allocated  a  number  of  trans¬ 
mission  time  slots.  When  not  transmitting,  each  element  monitors  the  trans¬ 
missions  of  all  other  elements  and  extracts  the  information  as  needed. 

Although  the  specific  benefits  of  JTIDS  have  not  been  documented, 
several  generic  benefits  affect  tactical  missions.  These  are: 
o  jam  resistant  communications, 
o  intercept  enhancement, 

o  "Beyond  Visual  Range"  threat  identification, 
o  supplementary  threat  warning, 
o  relative  nagivation, 
o  blind  NAV  bombing  capability. 

JTIDS  is  a  multiphased  program  which  is  scheduled  to  achieve  full 
operational  status  by  1984. 
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3. 2. 2. 6  Airborne  Warning  and  Control  System  (AWACS)  -  AWACS  will 

provide  air  surveillance  for  command,  control  and  communication  functions 
throughout  the  U.S.  and  overseas.  Its  radar  will  detect  and  track  aircraft 
at  any  altitude  over  land  and  water. 

3. 2. 2. 7  Global  Pos i tioning  Satell ite  (GPS)  -  GPS  will  provide  precise, 
three-dimensional  position  and  velocity  information  to  aircraft,  ships,  and 
ground  forces.  The  GPS  development  is  currently  in  the  validation  phase, 
with  early  results  indicating  that  the  system  can  meet  anticipated  accuracy 
requi rements.  Full  scale  development  should  begin  in  1982.  Eventually,  24 
satellites  will  be  orbited  for  full  global  coverage  by  1984. 


\ 
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General  mission  requirements  were  listed  earlier  (see  Figure  3.4)  for 
pre-flight,  in-flight,  and  post-flight  phases.  From  these  requirements, 
representative  mission  profiles  were  illustrated  for  Close  Air  Support,  Air 
Interdiction,  and  Counter  Air  missions  (see  Figures  3.5,  3.6,  and  3.7, 
respectively ). 


Our  intent  in  this  section  of  the  report  is  to  describe  the  mission 
requirements  in  more  detail.  This  is  followed  (in  Section  5 )  by  an  examina¬ 
tion  of  pilot  information  needs.  After  establishing  tactical  objectives  and 
defining  the  corresponding  information  requirements,  we  present  (in  Section 
6)  time  line  analyses  of  the  specific  tasks  which  must  be  performed. 

We  have  chosen  a  presentation  format  (adapted  from  Mills  et  al.,  1978) 
which  will  facilitate  comparison  of  the  requirements  for  the  principal  TACAIR 
missions.  The  numbering  scheme  used  to  identify  individual  mission  require¬ 
ments  is  the  same  as  that  used  in  Figure  3.4.  Notes  are  included  when 
further  clarification  or  differentiation  is  necessary.  We  should  emphasize, 
again,  that  the  mission  requirements  overlap  in  combat  situations. 
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FIGURE  4.1 


PRE-FLIGHT  MISSION  REQUIREMENTS  FOR  CLOSE  AIR 
SUPPORT,  AIR  INTERDICTION,  AND  COUNTER  AIR. 
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(4)  Most  pre-flight  tasks  are  performed  In  advance  of  an  alert.  Otherwise,  these  tasks  are  performed  just  prior 
to  the  mission.  Alert  status  requires  specified  aircraft  and  aircrews  and,  therefore,  reduces  the  resources 
available  for  other  missions  or  duties. 
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(18)  The  decision-making  process  Is  not  easy  to  explain.  Training,  ROEs,  previous  experience,  and  many  other 
factors  affect  split-second  decisions  to  release  weapons. 
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It  should  be  obvious,  frori!  even  a  cursory  reading  of  the  mission  require¬ 
ments,  that  a  combat  pilot  must  spend  considerable  time  processing  displayed 
information.  In  Section  3,  we  reviewed  the  various  display  units  which  will 
present  visual  information  during  the  1990s  (see  Figures  3.1  and  3.2).  In 
this  section,  we  are  concerned  with  the  specific  types  of  information  which 
must  be  displayed  at  different  stages  of  each  TACAIR  mission.  Therefore,  we 
have  provided  comprehensive  listings  of  information  requirements.  We  believe 
that  the  mission  and  information  requirements,  coupled  with  the  aircraft 
characteristics,  determine  the  assignment  and  sequencing  of  pilot  tasks. 

The  tabulations  which  appear  in  Figures  5.1  through  5.12  (adapted  from 
Mills  et  al.,  1978  )  indicate  whether  the  displayed  data  are:  required  (1), 
frequently  required  (2),  or  merely  of  additional  value  (3)  at  a  certain  stage 
of  the  mission.  Thus,  an  entry  of  "2"  or  "3"  signifies  that  this  particular 
information  is  less  essential  than  information  assigned  a  weight  of  "1." 
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AdlMMintlM 

Form* lion  CaH  Sign* 
Flight  Position 
Aircraft  Alignment 
Parking  Spot 

Spare  Procedure*  _  _ 

Ancrdti  Configuration 
Frequencies 
IFF/Slf  Procedure* 
Weathei 
Regulation* 


2  2  2  1  1 
11111 


2  2  2  1  2 
11111 
11111 
2  2  2  1  2 
11111 


1  2  2  2  2 
11111 


2  12  2  2 
112  2  2 
1112  2 
11111 
11111 


2  2  12  2 
11111 


2  1111 
2  2  2  2  2 
2  2  2  2  3 
11111 
11111 


2  2  12  2 
11111 


1  2  1 
1  1  1 
1  1  1 
1  2  1 
I  1  1 


2  2  2 
1  1  1 


2  1  1 
1  1  1 
1  1  I 
1  1  1 
1  1  1 


2  2  2  2 
1  2 


1  1 
1  1  1 


111111 


Airfield  Statu* 

Airfield  Description 
Landing  Runway 
Runway  Length 
Banter* 

Appi  cache* 

Missed  Approach  Instruction* 
An  held  Elevation 
Oecmon  Height 
Pa* king  Aiea 
I  a*  i  Routes 
Aiming  Area 
Deaiming  Area 
Alternate  Airfield 


1  1 
1  1 


2 

2 

2 

2 

1  1 


1112  1 


1  I 
1  1 


1  2  1 

1  1  1 

2  2  113 

1  1 
1  1  3 
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2  2  2  2  2 


2  2  2  2  2 


2  2  2  2  2 


2  2  2  2  2 


2  2 


1111 

1111 


Time 

Biiefmg  Time 
Station  Time 
Stall  Engine  Tima 
Flight  Check  In  Time 

T  jm  Time  _  _ _ 

Takeoff  Tune 

Air  Refueling  Contact  Time 
Time  on  Target 
lime  to  Climb 
Time  to  Go 

Conhot  Tunes _ 

1  amhng  T mie 
Rendezvous  Time 
f  monte  T imes 
Time  of  Day 


I 

I  1 
1  1 


2  2  2  2  2 


2  2  2  2  2 


112  11 

11111 

LLLU 

11111 

Itlli 
2  2  2  2  2 


2  I 


11111 


Caution  and  Warning  Systems 

Master  Cautiun 
Configuration  Warning* 

OiMrialing  l  imitation  Warning 
Primary  Systems  Fail 

F  i it- 1  l  ow  _  _ _  i 

Oaygen  Low 

Eiiviionirienlat  Control  System  Warning 
Autopilot  Disengaged 
Avionics  Malfunction* 

Altitude  Low 
Airspeed  Low 


1  1 
1  1 
1  1 
1  1 

_ 2_J 

1  i 
1 


t 

1 

i 

1 

-J_J 
1 
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1  i 


2  2  2  2  2  2 


11111 
2  2  2  2  2 
11111 
11111 
UJJJ 


1  1  1 
l  1  1 

1  !  1 


11111 


111111 
1111  1 


1111 

1  2  2 

3  3  2 

1111 

1  1  1 
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KtU 
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FIGURE  5.1  INFORMATION  REQUIREMENTS  FOR  CLOSE  AIR  SUPPORT. 
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PwtFHgM 


I  Fuel  OH  Loading 
Gcom  Wtiqht 
Auiopiloi  SuUnodet 
Auciatt  lighting 
9 


Communications 
Contiullmg  Agency 
Ah  trail  Call  Sign 
Authentication 
IFFSlF 

Clearances  _ _ _ _  _ _ 

Secure  Communication 
Frequencies 
lni«icom(ll  Required) 
Navigation  Aids  Identifiers 
Mimon  Reports 


Flight  Aids 
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6.0  PILOT  PERFORMANCE  AND 

BIOCYBERNETIC  APPLICATIONS 


The  preceding  sections  have  provided  a  framework  for  discussing  pilot 
tasks.  As  we  noted  earlier,  the  assignment  and  sequencing  of  tasks  are 
dependent  upon  the  aircraft  characteristics,  the  tactical  objectives,  and  the 
information  requi rements. 

Subsection  6.1  attempts  to  convey  the  dynamic,  time-varying  nature  of 
pilot  tasks.  Subsection  6.2  then  describes  the  biological  signals  which 
reflect  the  pilot's  status  or  which  may  permit  a  direct  coupliny  of  the  pilot 
with  aircraft  subsystems.  Finally,  Subsection  6.3  examines  the  manner  in 
which  biocybernetic  techniques  can  be  expected  to  improve  pilot  performance 
and  thus  enhance  weapons  system  effectiveness. 


6.1  TIME  LINE  ANALYSES  OF  PILOT  TASKS 


To  avoid  the  redundancy  of  presenting  detailed  task  listings  for  each 
mission  type,  we  have  generated  time  lines  for  those  tasks  commonly  associated 
with  segments  of  a  carrier  launched  escort  mission.  Figure  6.1  shows  that 
most  of  the  mission  segments  integrate  several  of  the  general  mission  require¬ 
ments  illustrated  previously  in  Figure  3.4.  Further,  we  have  included  both 
air-to-air  and  ai r-to-ground  scenarios,  as  evident  from  the  representative 
mission  profile  depicted  in  Figure  6.2. 
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FIGURE  6.1  SEGMENTS  OF  A  CARRIER  LAUNCHED  ESCORT  MISSION.  (THE 
FIGURE  SHOWS  THE  RELATIONSHIPS  BETWEEN  SEGMENTS  AND 
MISSION  REQUIREMENTS  PRESENTED  PREVIOUSLY  IN  FIGURE  3.4. 
SOME  OF  THE  SEGMENTS  (E.G.,  MRI)  ARE  COMPRISED  OF 
SEVERAL  MISSION  REQUIREMENTS.) 
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In  the  construction  of  dynamic  task  flows  (Figures  6.6  through  6.17),  we 

have  incorporated  existing  documentation  on  the  multimission  F/A  -  18  air¬ 
craft  (Wise  and  Asiala,  1977).  The  crew  station  of  this  aircraft  (see  Fiyure 
6.3)  has  been  designed  for  both  air-to-air  and  air-to-ground  inodes,  and  it 
features  many  of  the  avionics  advances  highlighted  in  Section  3. 

We  stated  in  the  Introduction  that  we  would  restrict  the  application  of 
biocybernetic  techniques  to  those  pilot  tasks  which  are  very  difficult,  are 
critical  to  the  success  of  the  mission,  or  occur  during  periods  of  heavy 
workload.  In  order  to  eliminate  less  essential  tasks  from  later  consideration 
(more  inclusive  listings  of  tasks  appear  in  the  time  line  analyses),  military 
pilots  familiar  with  the  F/A  -  18  crew  station  and  with  the  projected  mission 
requirements  rated  each  task  on  the  basis  of  difficulty  and  criticality.  The 
following  factors  were  taken  into  account  when  judging  task  difficulty: 
o  amount  of  information  that  must  be  processed, 
o  degree  to  which  the  relevant  cues  are  discernible, 
o  number  of  control  actions  and  precision  with  which  they  must  be 
performed, 

o  time  available  to  perform  the  task  (or  a  cluster  of  related  tasks), 
o  dependence  upon  an  integrative  process  in  reaching  a  decision, 
o  other  variables  (such  as  stress,  fear,  or  fatigue). 

While  the  relation  of  the  task  to  the  success  of  the  mission  was  emphasized 
in  estimating  criticality,  the  pilots  also  indicated  whether  performance  of 
the  task  affected  flight  safety. 
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We  have  defined  workload  in  terms  of  the  number  of  tasks  a  pilot  must 

perform  in  an  arbitrary  period  of  time.  For  each  mission  segment,  we  counted 
the  number  of  individual  tasks,  including  repetitions  of  the  same  task,  which 
are  presumed  to  occur  in  a  5  second  interval  (see  Figure  6.4).  Tasks  which 
continue  in  successive  intervals  were  counted  for  both  time  periods.  Descrip¬ 
tive  statistics  were  derived  from  these  tabulations.  Across  the  entire 
mission,  mean  "task  load"  per  5  second  interval  was  equal  to  3.93  tasks,  with 
a  standard  deviation  of  1.77  tasks.  High  task  load  intervals  were  assumed  to 
have  task  frequencies  greater  than  7.47  (two  standard  deviations  above  the 
mean).  The  tasks  which  appear  in  these  intervals  and  the  tasks  assigned  high 
ratings  with  regard  to  difficulty  or  criticality  comprise  the  row  headings  of 
the  biocybernetic  matrices  in  Subsection  6.3. 

The  time  lines  which  follow  are  meant  to  be  illustrative,  since  the 
duration  of  any  mission  segment  will  change  dramatically  as  conditions 
change.  To  demonstrate  the  process  of  creating  dynamic  task  flows,  we  have 
presented  complete  time  lines  for  launch,  surface-to-a i r  missile  (SAM) 
avoidance,  air  combat  maneuvering  (ACM),  and  landing.  For  the  remainder  of 
the  mission  segments,  time  lines  are  provided  for  only  the  high  task  load 
intervals.  In  general,  the  task  listings  should  be  read  from  bottom  to  top. 
Further,  the  reader  may  find  it  helpful  to  refer  again  to  the  relevant 
mission  and  information  requirements  described  in  Sections  4  and  5,  respec¬ 
tively.  A  brief  narrative  introduces  each  mission  segment. 
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6.1.1  Launch  -  Within  this  60  second  segment,  the  pilot  catapults  from 
the  carrier,  establishes  and  maintains  proper  attitude  for  climb,  and  retracts 
the  landing  gear  and  flaps  for  normal  flight.  Throughout  the  segment, 
critical  flight  data  are  processed  and  attitude  adjustments  are  performed. 
Visual  search  of  surrounding  airspace  is  required  to  monitor  the  position  of 
the  other  escort  aircraft  (assuming  a  dual  launch). 
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6.1.2  Cl  i mb  -  The  lead  pilot  joins  with  his  wingnian,  and  they  climb 
to  their  assigned  altitude.  Both  pilots  are  in  constant  communication  with 
the  air  traffic  controller  and  with  each  other.  Climb  and  level-off  checks 
are  frequent,  as  is  the  monitoring  of  other  flight  parameters.  Once  clear 
of  the  carrier,  the  pilots  establish  proper  spacing  between  their  aircraft 
and  then  engage  the  Automatic  Flight  Control  System  (AFCS).  The  flight 
monitoring  tasks  continue  throughout  the  mission  segment.  Addi tional ly,  the 
Identification-Friend  or  Foe  (IFF)  system  is  activated,  and  preliminary 
subsystems  checks  are  performed. 
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6.1.3  Rendezvous  -  The  escort  pilots  are  principally  concerned  with 
joining  the  strike  force.  Radar  parameters  are  selected  (to  assist  in  the 
location  process)  and  then  a  system  check  is  performed.  The  pilot  also  must 
achieve  UHF  communication  with  the  strike  force.  Since  most  of  the  flying  is 
conducted  under  AFCS,  task  load  is  relatively  low.  The  pilot  continuously 
monitors  displayed  flight  data  and  the  position  of  the  other  escort  aircraft. 
Once  the  strike  force  is  joined,  the  pilot  disengages  the  AFCS  to  begin 
formation  flying. 
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6.1.4  Ingress  -  This  segment  commences  as  the  aircraft  cross  the 
forward  edge  of  the  battle  area  (FEBA).  Counter-threat  and  armament  sub¬ 
systems  are  set  and  checked,  and  the  pilot  flies  a  level  weave  maneuver  until 
the  strike  force  reaches  the  target  or  until  ingress  is  interrupted.  To 
reduce  the  possibility  of  detection  by  enemy  ground  forces,  the  radar  alti¬ 
meter  is  deactivated. 
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FIGURE  6.8  DYNAMIC  TASK  FLOWS  FOR  INGRESS. 
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6.1.5  Medium  Range  Intercept  (MRI )  -  Should  enemy  fighters  be  encoun¬ 
tered,  the  escort  aircraft  must  defend  the  strike  force.  Therefore,  fire 
control  functions  have  the  highest  priority  within  this  segment.  Pilot 
responsibilities  include: 

o  configuring  the  aircraft  subsystems  for  the  appropriate  attack 
mode , 

o  selecting  azimuth  and  elevation  coordinates  for  radar  antenna, 
o  monitoring  radar  display  and  IFF  evaluator, 
o  arming  and  assessing  status  of  selected  missile, 
o  achieving  target  lock-on, 

o  maneuvering  so  that  the  enemy  aircraft  is  positioned  within  the 
missile  launch  envelope, 
o  firing  the  missile, 
o  observing  flight  path  of  the  missile. 

The  outcome  of  the  engagement  is  communicated,  the  master,  arm  is  set  to  safe, 
and  navigation  data  are  processed.  The  pilot  then  will  proceed  to  rejoin  the 
strike  force. 
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6.1.6  Surf ace-to-Ai r-Mi ssi 1 e  (SAM)  Avoidance  -  Should  a  warning  of 
possible  SAM  launch  be  displayed  to  the  pilot,  he  must  determine  the  azimuth 
of  the  SAM  site  and  inform  the  other  pilots  of  the  direction  of  the  threat. 
If  a  SAM  1  auncli  is  confirmed,  the  pilot  must  bt^in  to  search  visually  for  the 
missile.  He  also  will  dispense  chaff  and  flares  to  decoy  the  missile  or  will 
initiate  jamming  to  confuse  the  missile's  radar.  If  the  missile  cannot  be 
detonated  or  avoided  in  this  manner,  the  pilot  must  perforin  evasive  flight 
maneuvers.  He  will  track  the  smoke  trail  of  the  missile  so  that  he  may  time 
the  necessary  abrupt  changes  in  altitude,  velocity,  and  direction. 
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6.1.7  Air  Combat  Maneuvering  (ACM)  -  When  "beyond  visual  range"  threats 
are  first  encountered,  long  or  medium  range  missiles  (Subsection  6.1.5)  are 
deployed.  Should  these  weapons  prove  ineffective  (due  to  enemy  maneuvering 
or  an  inability  to  achieve  lock-on)  or  should  enemy  aircraft  successfully 
avoid  radar  defenses,  then  close-in  combat  will  result.  Consequently,  within 
this  segment  we  are  concerned  with  those  tasks  related  to  either  AIK-9 
(Sidewinder)  missile  or  gun  attack.  It  should  be  noted  that  crucial  flight 
ana  weapons  data  are  displayed  on  the  HUD  in  order  to  maximize  the  time 
available  to  the  pilot  for  visually  tracking  the  enemy  aircraft.  A  compli¬ 
cating  factor  is  the  high  g  environment  in  which  the  tasks  must  be  performed, 
since  violent  rnanuevering  is  required  to  properly  align  the  weapons  with  the 
target  and  to  position  the  target  within  the  missile  launch  or  gun  envelope. 
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6.1.8  Ai  r-to-Ground  (A/G )  Strike  -  Escort  aircraft  may  participate  in 
attack  of  ground  targets,  especially  during  Air  Interdiction.  We  have 
assumed  low  altitude  penetration  and  that  the  location  of  the  targets  is 
stored  within  the  TACAN  computer  prior  to  the  mission.  Moreover,  we  have 
assumed  delivery  of  ballistic  weapons  and,  given  consent,  that  the  actual 
time  of  release  is  computed  automatically.  The  pilot  must  select  the  approp¬ 
riate  armament  program  and  determine  that  he  is  in  the  vicinity  of  the  target 
area  before  he  initiates  "pop-up."  When  he  reaches  target-unmask  altitude 
and  acquires  the  target  visually,  the  pilot  will  maneuver  the  aircraft  until 
the  target  is  observed  to  be  within  the  HUD  f i el d-of- vi ew.  He  then  will 
depress  the  "pickle"  (weapons  release)  button  and  continue  to  track  the 
target  until  the  flashing  symbology  indicates  release  of  the  bomb.  This  cue 
also  signals  pull-up,  and  the  pilot  subsequently  will  establish  heading  for 
egress  from  the  target  area. 
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6.1.9  Egress  -  This  segment  commences  as  the  aircraft  leave  the  target 
area.  The  pilot  frequently  processes  flight  data,  adjusts  flight  controls, 
and  monitors  surrounding  airspace.  Further,  counter-threat  and  armament 
subsystems  are  reset  and  rechecked. 
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6.1.10  I n-F  1  i  ght  Refuel  -  While  in  cruise,  the  pilot  will  select 
altitude,  heading  and  attitude  coordinates  for  the  Automatic  Flight  Control 
System  (AFCS).  He  also  will  designate  the  approximate  location  of  the 
tanker  aircraft  and  will  adjust  radar  parameters  for  a  more  precise  deter¬ 
mination  of  the  refueling  site.  Once  lock-on  is  achieved,  the  pilot  will 
deactivate  the  AFCS  to  maintain  close  formation  during  approach  to  the  tanker 
fleet.  Rendezvous  typically  will  occur  at  20,000  ft.,  at  least  50  nm  from 
the  FEBA.  The  remainder  of  the  tasks  within  this  segment  are  associated  with 
the  actual  refueling  operation  (e.g.,  extension  of  the  probe,  activation  of 
the  refueling  switches,  and  retraction  of  the  probe). 
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6.1.11  Marshal  -  Prior  to  approach  for  carrier  landing,  the  escort  and 
strike  aircraft  will  break  formation  and  will  descend  to  establish  a  holding 
pattern  until  clearance  is  received.  While  in  the  pattern,  the  pilot  will 
engage  the  AFCS  in  order  to  perform  various  housekeeping  checks  arid  to 
configure  the  subsystems  for  approach  and  landing.  He  also  will  monitor  Ins 
position  in  the  pattern  to  assure  proper  in-flight  alignment  (IFA)  during 
approach.  In  addition,  IFF  codes  are  again  verified  to  maximize  classifica¬ 
tion  of  "beyond  visual  range"  threats.  Finally,  the  Instrument  Landing 
System  (ILS)  is  set  to  standby  and  the  proper  heading  is  selected. 
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6.1.12  Prel  andi  ng  -  During  approach,  the  pilot's  principal  objectives 
are  to  arrive  at  the  outer  marker: 
o  in  the  assigned  time  slot, 

o  at  the  appropriate  altitude,  attitude,  heading  and  airspeed. 
Therefore,  housekeeping  functions  receive  the  highest  priority  within  this 
segment. 
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6.1.13  Landing  -  The  tasks  in  this  segment  are  performed  during  a  fully 
coupled  approach.  A  carrier-based  system  monitors  relevant  flight  parameters 
(attitude,  altitude,  heading,  glide  slope,  vertical  velocity,  and  airspeed) 
and,  via  data  link,  automatically  adjusts  the  aircraft's  flight  controls  to 
compensate  either  for  deviations  from  commanded  levels  or  for  changes  in  the 
orientation  of  the  flight  deck.  Essentially,  the  pilot  must  process  displayed 
flight  data  and  must  remain  prepared  to  assume  manual  control  if  a  system 
discrepancy  is  detected.  He  also  must  extend  the  gear,  flaps  and  arresting 
hook.  Just  before  touchdown  occurs,  the  pilot  must  visually  track  the  glide 
path  and  observe  the  altitude  indicator  (meatball)  at  the  end  of  the  runway. 
At  touchdown,  the  pilot  must  apply  thrust  until  the  arresting  hook  catches. 
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FIGURE  6.17  DYNAMIC  TASK  FLOWS  FOR  LANDING. 


mcdowivell  oououab  abtbonauticb  compawt-st.  lolmb  cmwjm>w 


BIOCYBERNETICS  AND  PILOT  PERFORMANCE 


1  OCTOBER  1979  MDC  E2046 

6.2  REAL-TIME  ANALYSIS  AND  INTERPRETATION  OF  BIOLOGICAL  SIGNALS 


Obviously,  the  pilot  is  extensively  involved  in  monitoring  displays 
and  operating  controls  (flight  controls  and  various  subsystem  controls). 
Overall  mission  success  will  be  compromised  when  individual  objectives 
cannot  be  achieved  because  the  inherent  requirements  for  processing  informa¬ 
tion  and  initiating  control  actions  exceed  the  capabilities  of  the  pilot.  We 
stated  earlier  that  programmable,  electronic  displays  and  multipurpose 
keyboards  offer  one  approach  to  limiting  and  sequencing  display  presentations 
according  to  the  pilot's  information  needs  at  a  given  stage  of  the  mission. 
By  restricting  presentations  to  essential  flight,  subsystem,  and  target 
parameters,  the  possibility  that  extraneous  visual  events  will  vie  for  the 
pilot's  attention  is  minimized.  Similarly,  by  integrating  critical  subsystem 
(e.g.,  weapons )  controls  directly  into  the  stick  arid  throttle,  the  speed  of 
response  is  increased  and  the  associated  expenditure  of  physical  effort  is 
reduced. 

These  and  other  engineering  advances  are  certainly  important.  However, 
we  believe  that  the  pilot's  effectiveness  could  be  further  enhanced  if  (a) 
his  current  status  as  a  processor  of  information  and  as  a  deci si ori-maker  were 
monitored,  and  (b)  he  were  coupled  more  directly  with  the  aircraft  subsystems 
from  a  control  standpoint. 

We  noted  in  the  Introduction  of  this  report  that  the  program  of  biocyber¬ 
netics  research  sponsored  by  DARPA  has  attempted  to  develop  a  communication 
channel  for  biological  signals  elicited  during  different  mental  activities. 
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It  is  assumed  that  through  real-time  analysis  and  interpretation  of  these 

signals  the  computer  will  be  able  to  determine  (within  certain  limits): 

o  when  visual  or  auditory  information  has  not  been  processed, 

o  when  the  pilot  is  inattentive, 

o  when  the  pilot  is  task-loaded  to  the  extent  that  he  is  unable  to 
perform  additional  duties, 

o  when  the  pilot  lacks  confidence  in  a  decision  he  has  made. 

Subsection  6.3  outlines  the  courses  of  action  which  may  be  taken  should  it  be 
necessary  to  unburden  or  assist  the  pilot.  They  include,  among  others: 

o  redistributing  task  responsibilities  by  effecting  greater  automation 
of  certain  housekeeping  functions, 

o  reducing  the  complexity  of  or  "decl  uttering"  information  displays, 
especially  the  HUD, 

o  cueing  the  pilot  to  attend  to  critical  flight,  weapons,  and  target 
data, 

o  displaying  adaptive  decision  aids  which  present  weighted  recommenda¬ 
tions  for  mission-related  decision  strategies,  particularly  with 
respect  to  fire  control  functions, 

o  furnishing  remedial  "checklists," 

o  optimizing  the  physical  characteristics  (e.g.,  contrast,  focus,  etc.) 
of  imagery  and  symbolic  presentations. 

We  also  will  discuss  "thought"  commands  and  eye  position  sensing  as  two  means 
of  suppl ement ing  manually  operated  or  voice  actuated  control  systems. 

In  order  to  justify  the  recording  (noninvasive  and  unobtrusive)  of 
biological  data,  there  are  certain  a  priori  conditions  which  must  be  satis¬ 
fied.  According  to  Donchin  (in  press),  it  first  must  be  shown  that  clearly 
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delineated  and  unique  patterns  of  biological  activity  are,  in  fact,  associated 

with  specific  mental  (cognitive)  functions;  the  signals  cannot  be  ambiyuous. 
Moreover,  the  signals  must  be  interpretable  in  real-time  as  the  pilot  performs 
his  tasks.  Progress  has  been  made  in  defining  patterns  of  biological  activity 
that  are  related  to  the  efficacy  of  various  cognitive  functions  (cf.  Thatcher 
and  John,  1977;  John,  1977).  Further,  very  significant  improvements  have 
been  reported  regarding  the  procedures  used  to  extract  (from  noise)  and 
classify  these  “messages"  in  real-time  (John  et  al.,  1978).  These  advances 
notwithstanding,  a  great  deal  more  must  be  accomplished  (in  computer  tech¬ 
nology,  software  development,  and  the  design  of  physi ol ogi cal  monitoring 
equipment)  before  it  is  both  feasible  and  practical  to  implement  biocybernetic 
techniques  in  dynamic,  operational  environments.  Nonetheless,  we  assume  that 
the  necessary  breakthroughs  will  continue  to  occur. 

Our  intent  in  this  subsection  is  to  briefly  review  the  biological 
signals  which  are  most  relevant  for  our  purposes.  Figure  6.18  distinguishes 
the  two  categories  of  signals  we  have  considered,  that  is,  brain  electrical 
activity  and  peripheral  activity.  Since  our  principal  concern  is  with 
monitoring  brain  function,  the  term  "peripheral "  denotes  biological  activity 
in  response  systems  other  than  the  central  nervous  system.  The  figure  also 
lists  two  types  of  signals  within  each  category,  and,  at  a  more  molecular 
level,  presents  distinct  informational  features  or  components  of  two  of  the 
four  types. 

Of  necessity,  we  have  omitted  many  important  details  of  the  basic 
research  findings  in  electrophysiology  and  biological  signal  processing  which 
provide  a  foundation  for  the  applications  we  have  suggested.  Therefore,  we 
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encourage  the  reader  to  consult  the  Proceedings  of  the  DARPA  Conference  on 

Biocybernetic  Applications  for  Military  Systems  (Gomer,  in  press)  and  the 
many  excellent  textbooks  and  chapters  (cf.  Chapman,  1973;  Desmedt,  1979; 
John  and  Schwartz,  1978;  McCallutn  and  Knott,  1973,  1976;  Otto,  1979;  Thompson 
and  Patterson,  1974)  for  more  complete  descriptions  of  the  progress  that  has 
been  made  in  these  areas. 

6.2.1  Brain  Electrical  Activity  -  In  order  to  evaluate  brain  function 
while  a  crew  member  performs  a  demanding  task,  we  must  rely  upon  electro- 
physiological  techniques  to  observe  the  underlying  interactions  within  and 
between  populations  of  cortical  cells.  Donchin  (in  press),  John  (1977),  and 
Thatcher  and  John  (1977)  have  suggested  that  cognitive  operations  can  be 
conceptualized  in  terms  of  coherent  patterns  of  activity  within  distributed 
cell  groups.  And  importantly,  orderly  neural  behavior  gives  rise  to  rhythmic 
voltage  fluctuations  in  the  two  types  of  scalp  recorded  electrical  activity 
identified  in  Figure  6.18. 

El  ectroencephal  ographic  (EEG)  activity  consists  of  spontaneous  or 
on-going  voltage  fluctuations  (see  Figure  6.19).  Event-related  potentials 
(ERPs),  on  the  other  hand,  are  transient  voltage  fluctuations  which  are 
associated  with  a  critical  inducing  event  (i.e.,  a  sensory  stimulus  or  a 
cognitive  operation)  and  which  are  imbedded  in  the  EEG  activity.  Since  the 
EEG  is  generally  more  pronounced  in  amplitude,  it  usually  obscures  the 
waveform  of  the  ERP.  However,  there  are  several  strategies  for  extracting 
and  measuring  ERPs  (or  selected  "components")  in  real-time  (John  et  al., 
1978). 
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FIGURE  6.19  ELECTROENCEPHALOGRAM  OF  A  NORMAL  HUMAN  ADULT.  (ALPHA  WAVES 
AT  ABOUT  10  PER  SECOND  PREDOMINATE  IN  ALL  REGIONS  BUT  ARE 
LARGEST  POSTERIORLY.  ONLY  A  FEW  SMALLER  AND  FASTER  BETA 
WAVES  ARE  VISIBLE  IN  THE  ANTERIOR  REGIONS.  (FROM  LINDSLEY, 
1948)) 


A fCOOlWWLL  DO  VOL  AM  AMTmOMAUTICM  COMPAMT-tT  LOUM  INVIWOM 


*  T»-*«  v  ' 


I 


BIOCYBERNETICS  AND  PILOT  PERFORMANCE 


> 


: 

! 


i 

*1 


* 

* 

% 

fc 

«: 


p. 


I 

I 

I 

I 

I 


1  OCTOBER  1979  MDC  E2046 

If  a  discrete  visual  stimulus  is  presented  to  an  observer  who  must 

classify  it  and  then  signify  the  decision  he  has  reached  with  a  behavioral 
response,  the  resultant  ERP  is  composed  of  successive  positive  and  negative 
deflections  continuing  for  up  to  750  msec  post  stimulus.  Figure  6.20  depicts 
such  a  waveform  in  which  the  major  deflections  or  components  have  been 
labeled  by  a  character-number  designation.  The  character  refers  to  the 
polarity  of  the  component  (P  =  positive,  N  =  negative),  while  the  number 
indicates  the  temporal  delay  or  latency  between  the  eliciting  event  and  the 
peak  voltage  of  the  component. 

The  morphology  of  the  components  occuring  within  200  msec  after  stimulus 
onset  is  influenced  markedly  by  the  physical  attributes  (e.g.,  wavelength, 
intensity  or  contrast)  of  the  evoking  stimulus  (cf.  Regan,  1972).  Conse¬ 
quently,  these  so-called  early  components  are  referred  to  as  exogenous.  If 
the  input  must  be  processed  and  a  decision  reached,  the  prominence  of  late  or 
endogenous  component  activity,  particularly  P.j00,  i s  affected.  The  term 
"endogenous"  signifies  that  these  components  are  not  affected  by  the  sensory 
qualities  of  external  events. 

The  location  of  recording  electrodes  must  be  given  careful  consideration 
when  denoting  the  amplitude  and  latency  of  ERP  components.  This  follows  from 
the  previously  stated  position  that  neural  representations  of  information 
processing  and  decision-making  involve  the  coordinated  behavior  of  disparate 
cell  populations.  Thus,  the  spatiotemporal  distribution  of  late  component 
activity,  when  referenced  to  the  International  Electrode  Placement  System 
(Figure  6.21),  is  a  most  important  indicator  of  cognitive  function  (cf.  Adam 
and  Collins,  1978;  Courchesne,  et  al.,  1975;  Goff,  et  al.,  1978;  Thatcher, 

1976  ). 
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.20  VERTEX  EVENT-RELATED  POTENTIAL  ELICITED  BY  A  MATCHING 
LETTER  PRESENTATION  DURING  AN  ITEM  RECOGNITION  TASK. 
(FROM  GOMER  ET  AL.,  1976) 
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FIGURE  6.21  LATERAL  AND  SUPERIOR  VIEWS  OF  INTERNATIONAL  ELECTRODE 
PLACEMENT  SYSTEM. 
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One  may  question  whether  it  will  be  possible  to  evaluate  some  of  the  ERP 

components  during  tactical  missions,  since  discrete  vi sual  events  are  rarely 
presented  to  the  pilot  (other  than  in  the  form  of  check  list  items).  Rather, 
alpha  numerics,  symbolic  characters,  and  sensor  imagery  are  displayed  continu¬ 
ously,  and  they  change  in  content  or  value  dynamical l,y.  Donchin  (in  press) 
has  shown  that  discrete  probe  stimuli  (in  this  case  auditory)  can  be  intro¬ 
duced  artifically  into  those  situations  in  which  dynamic  visual  events 
predominate.  By  analyzing  "background"  responses  (principally  P^qq  )  to 
these  probes  we  can  infer  how  well  the  operator  is  performing  "foreground" 
tasks. 

"Foreground"  activities  can  be  assessed  directly  however.  That  is,  we 
can  evaluate  the  EEG  changes  which  accompany  i  n format  ion  processing  and 
decision-making  operations  that  are  integral  to  the  housekeeping  and  mission- 
related  tasks  performed  by  the  pilot.  The  EEG  is  categorized  with  respect  to 
two  basic  dimensions,  frequency  and  amplitude.  Usual  frequency  bands  are: 

o  delta  (.5  -  4Hz), 

o  theta  (5  -  7Hz), 

o  alpha  (8  -  12Hz), 

o  beta  (18  -  30Hz). 

Energy  distributions  can  be  measured  within  these  and  more  restricted  fre¬ 
quency  bands  at  each  recording  site.  In  fact,  energy  asymmetries  in  homo¬ 
logous  leads  (left  vs.  right  hemisphere)  may  be  quite  sensitive  to  subtle 
differences  in  cognitive  function. 
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Figure  6.18  lists  other  endogenous  components,  two  of  which  are  of 

additional  value  for  monitoring  pilot  status.  The  contingent  negative 
variation  (CNV)  is  a  slow,  negative  shift  in  EEG  baseline  which  develops  in 
the  interval  between  successive  presentations  of  discrete  stimulus  events 
(see  Figure  6.22).  The  time  course,  amplitude,  and  scalp  distribution  of 
this  waveform  provide  a  general  index  of  attentiveness  (Donchin,  in  press). 
Thus,  the  probe  technique  which  has  been  used  to  elicit  P300  can  also  be 
used  to  generate  CNV  responses.  The  detection  potential  (DP),  in  contrast, 
is  a  transient  change  in  EEG  activity  which  is  associated  with  the  detection 
of  dynamic  target  events  (McCall um,  in  press;  Cooper  et  al.,  1977  ).  McCall  urn 
and  his  colleagues  discovered  this  event-related  slow  potential  during 
preliminary  studies  of  extended  vigilance  performance.  Operators  viewed  a 
static  landscape  which  was  displayed  on  a  television  monitor.  At  random  time 
periods,  one  of  several  vehicular  targets  would  appear  in  the  scene  and 
traverse  the  terrain  along  a  prescribed  route.  These  scientists  found  that  a 
well  defined,  positive-going  potential  reliably  preceded  behavioral  indica¬ 
tions  of  target  detection  (see  Figure  6.23).  Moreover,  control  experiments 
have  established  that  this  component  is  not  related  to  the  initiation  of 
motor  responding  per  se  and  that  it  has  a  predominant  centroparietal  scalp 
distribution.  If  the  scope  of  these  investigations  can  be  expanded  to 
incorporate  more  demanding  target  acquisition  requirements,  then  the  pilot's 
part ic i pat i on  in  a  very  important  fire  control  function  can  be  monitored 
directly. 
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Si  S2 


FIGURE  6.22  TYPICAL  CNV  WAVEFORM  RECORDED  FROM  VERTEX  ELECTRODE  PLACEMENT. 

(SI  AND  S2  DENOTE  SUCCESSIVE  STIMULUS  EVENTS.) 
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FIGURE  6.23  (TOP)  THE  DISPLAYED  SCENE  AND  (BOTTOM)  THE  EYE-SCAN  PATTERN  AND  VERTEX  EEG 
OF  ONE  SUBJECT  BEFORE  AND  AFTER  DETECTION  OF  VEHICLE.  (THE  VEHICLE 
TRAVELED  FROM  RIGHT  TO  LEFT  ACROSS  THE  MIDDLE  OF  THE  DISPLAY,  AT  THE 
START  OF  THIS  SECTION  OF  THE  RECORD  THE  EYES  WERE  LOOKING  AT  THE  CENTER  OF 
THE  DISPLAY.  AT  A  THE  EYES  MOVED  TO  THE  LEFT  SIDE  AND  SCANNED  THERE  UNTIL 
B  WHEN  SACCADES  TO  THE  UPPER  CENTER  C  AND  RIGHT  DE_  OCCURRED,  FOLLOWED  BY 
DETAILED  MOVEMENTS  LEADING  TO  THE  DETECTION  POTENTIAL  AT  F  AND  TRACKING 
THEREAFTER.  ALL  SIX  VEHICLES  ARE  SHOWN.  (FROM  COOPER  ET  AL.,  1977)) 
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We  stated  earlier  that  the  recording  and  analysis  of  brain  electrical 

activity  also  may  permit  a  direct  coupling  of  the  pilot  with  aircraft  sub¬ 
systems  from  a  control  standpoint.  At  issue  is  whether  it  will  be  possible 
to  interpret  bioelectric  manifestations  of  different  thoughts  as  they  occur, 
whereby  the  pilot  can  "think"  to  activate  switches  or  guide  control  actions. 
Pinneo  and  his  colleagues  at  Stanford  Research  Institute  were  funded  by  DARPA 
to  develop  this  particular  communication  link  (Pinneo  et  al.,  1975  ).  Their 
primary  objective  was  to  isolate  features  in  the  EEG  data  that  are  associated 
with  specific  thoughts.  They  also  attempted  to  devise  computer  pattern 
recognition  programs  that  would  identify  these  features  on-line.  For  a  small 
vocabulary  of  individual  commands,  they  concluded  that  consistent  patterns 
are  present  in  that  EEG  activity  which  is  coincident  with  the  thinking  of  a 
particular  word.  Further,  these  patterns  can  be  recognized  and  classifed  by 
a  computer  a  statistically  significant  percentage  of  the  time.  It  must  be 
noted,  however,  that  this  process  is  not  yet  sufficiently  reliable  to  be  used 
in  a  practical  system. 

There  often  is  a  need  to  increase  the  speed  with  which  a  control  action 
is  initiated,  such  as  in  weapons  release  during  air-to-air  gun  attack. 
Researchers  have  discovered  a  negative  slow  potential  shift,  termed  the 
"readiness  potential"  (RP  )  (see  Figure  6.24),  which  precedes  the  actual 
execution  of  a  voluntary  manual  response  by  as  much  as  several  hundred 
milliseconds  (cf.,  Donchin,  1979;  Ga i 1  lard,  1978).  It  is  an  electrophysio- 
logical  indication  of  the  intent  to  commence  responding.  This  negative  wave 
should  not  be  confused  with  the  CNV  that  was  described  previously.  Whereas 
the  RP  is  movement-related,  the  CNV  is  influenced  by  variables  which  modulate 
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VOLUNTARY  MOVEMENTS 
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time  (sec) 


FIGURE  6.24  EXAMPLES  OF  VERTEX  READINESS  POTENTIALS  ASSOCIATED  WITH 
FINGER  PRESSES  DURING  A  REACTION  TIME  TASK  AND  DURING 
VOLUNTARY  MOVEMENTS.  (FROM  GAILLARD,  1978) 
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attentiveness  to  task  demands.  Moreover,  Gaillard  (1978  )  notes  that  the  RP 

is  distributed  more  posteriorly  than  the  CNV  and  that  the  RP  is  bilaterally 
asymmetrical  while  the  CNV  is  bilaterally  symmetrical. 

To  reiterate,  there  are  certain  conditions  which  must  be  satisfied 
before  el  ectrophysiol ogical  signals  will  be  valuable  in  the  context  of 
military  appl ications.  With  respect  to  monitoring  pilot  status,  clearly 
delineated  and  unambiguous  patterns  of  brain  electrical  act i vi ty  must  be 
associated  with  information  processing,  attentiveness,  and  decision-making. 
Further,  optimal  patterns  of  activity  (profiles)  must  be  defined  for  these 
cognitive  functions  as  a  pilot  successfully  performs  housekeeping  and 
mission-related  tasks.  The  profiles  must  be  continuously  updated  and  stored 
in  computer  memory  onboard  the  aircraft.  Current  el  ectrophysiol  ogical  data 
which  are  recorded  during  the  various  stages  of  the  mission  must  be  evaluated 
in  comparison  with  the  profiles  for  deviations  from  acceptable  levels.  In 
the  case  of  control  system  applications,  we  again  must  identify  specific 
features  of  brain  electrical  activity  which,  in  this  instance,  correspond 
with  distinct  thoughts  and  with  the  intent  to  initiate  a  manual  response. 

And  as  we  stated  with  regard  to  pilot  status,  current  electrophysiological 
data  must  be  matched,  in  real-time,  with  these  unique  profiles. 

6.2.2  Peripheral  Activity  -  While  we  have  deliberately  focused  on  brain 
electrical  activity  and  cognitive  function,  we  recognize  the  importance  of 
monitoring  the  pilot's  reaction  to  chronic  and  acute  stress.  We  are  referring 
not  only  to  environmental  stressors,  such  as  g  forces  or  hypoxia,  but  also  to 
psychological  stressors,  such  as  workload.  If  considerable  bodily  resources 

must  be  mobilized  for  extended  time  periods  to  restore  the  "status  quo,"  then 
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the  pilot's  proficiency  in  performing  critical  tasks  will  deteriorate. 

Therefore,  we  assume  that  sustained  increases  in  certain  types  of  biological 
activity  (or  perhaps  in  the  variability  of  a  particular  measure)  will  reflect 
difficulty  in  coping  with  stress.  We  very  briefly  describe  psychophysio- 
logical  activity  in  three  response  systems  that  have  been  studied  to  assess 
levels  of  anxiety,  tension,  or  physical  effort. 

Within  this  subsection  we  also  review  ocular  activity  from  two  perspec¬ 
tives.  We  begin  by  examining  the  dynamics  of  eye  movements  (i.e.,  timing, 
velocity,  and  pattern)  as  they  relate  to  information  extraction  and  proces¬ 
sing.  Then  we  discuss  the  concept  of  eye  control. 

6.2.2. 1  Psychophys i ological  Responses  -  Surface  recordings  of  electro¬ 
myographic  ( EMG )  activity  are  widely  used  to  evaluate  changes  in  tension  and 
physical  effort  (cf.  Goldstein,  1972;  Johnson,  in  press).  Electrodes  are 
placed  on  the  skin  over  various  muscle  groups,  although  forehead  and  neck 
leads  are  usually  included  when  the  effects  of  psychological  stressors  are 
examined.  The  electrical  activity  generated  in  the  muscles  is  frequently 
rectified  and  integrated  over  an  interval  of  time,  the  duration  of  which 
depends  upon  the  purpose  for  the  recording. 


Shifts  in  cardiovascular  activity  also  occur  in  response  to  stress  and 
changes  in  physical  effort.  The  parameters  of  interest  to  most  investigators 
have  been  (a)  heart  rate  and  rhythm  and  (b)  blood  flow  and  pressure  (Gunn  et 
a  1  . ,  1972  ).  Heart  rate  (HR)  has  been  the  preferred  datum  when  evaluating 
anxiety  or  tension,  due  largely  to  practical  difficulties  in  acquiring  the 
other  data  during  simulation  and  operational  testing.  Direct  measurement 
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techniques  consist  of  (a)  recording  the  electrical  activity  generated  by 

contraction  and  relaxation  of  cardiac  muscle  -  the  electrocardiogram  (ECG), 
and  (b)  detecting  the  corresponding  heart  sounds  -  the  phonocardiogram. 
Indirect  techniques  usually  involve  some  form  of  sensing  the  changes  in 
peripheral  blood  flow.  There  is  a  question,  however,  whether  fluctuations 
in  mean  HR  or  in  HR  variability  provide  the  most  sensitive  indication  of 
physical  status. 

Similarly,  both  the  rate  and  depth  of  respiration  increase  significantly 
when  subjects  are  exposed  to  periods  of  stress.  The  most  common  methods  for 
measuring  these  parameters  incorporate  impedance,  strain  gauge,  or  thermistor 
techniques.  It  must  be  noted  that  respiratory  patterns  are  disrupted  by 
speech,  thereby  limiting  the  value  of  rate  and  amplitude  recordings  during 
certain  mission  segments. 

Our  goal,  as  far  as  monitoring  the  pilot  is  concerned,  is  to  identify 
consistent  patterns  of  activity  -  not  only  in  individual  psychophysiol ogical 
measures  but  in  a  group  or  groups  of  measures  -  that  are  related  to  distinct 
changes  in  anxiety,  tension,  and  physical  effort. 

6. 2. 2. 2  Ocular  Activity  -  It  is  generally  accepted  that  eye  movements 
reflect  the  observer's  distribution  of  attention  within  visual  space  (cf. 
Krebs  et  al.,  1977).  However,  the  timing  and  velocity  of  these  movements  may 
also  reveal  the  effectiveness  with  which  a  pilot  processes  information.  We 
suggest  that  ocular  measures  may  supplement  electrophysiological  measures  of 
cognitive  function  during  display  monitoring  tasks.  A  more  detailed  discus¬ 
sion  of  the  types  of  eye  movements  and  their  relation  to  perception  and 
cognition  is  presented  by  Cumining  (1978). 
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Large  movements  orient  the  eye  so  that  the  high  resolution  area  of  the 

retina  (the  fovea)  is  directed  toward  the  point  of  interest  within  the  visual 

scene.  We  can  define  three  classes  of  large  eye  movements.  Saccades  are 

voluntary,  abrupt  changes  in  fixation  between  points  located  at  the  same 

viewing  distance.  They  are  characterized  by  accelerations  and  decelerations 

2 

of  up  to  40,000  deg/sec  and  by  peak  velocities  of  480  to  6GU  deg/sec. 
Saccadic  eye  movements  during  visual  search  typically  subtend  1  to  40  deg. 
Smooth  movements,  on  the  other  hand,  occur  when  the  eyes  track  an  object 
which  moves  vertically,  obliquely,  or  laterally  in  the  range  of  1  to  30 
deg/sec.  These  movements  are  also  produced  to  compensate  for  head  or  body 
motion  as  the  observer  fixates  on  a  stationary  object.  Finally,  vergence 
movements  allow  the  eyes  to  adjust  to  changes  in  viewing  distance  or  depth . 


Even  when  an  observer  carefully  attempts  to  maintain  precise  fixation, 
small  movements  inevitably  persist.  These  movements  are  classified  as 
tremor,  microsaccades,  and  drifts.  According  to  Cumming  (1978): 


"Tremor  is  a  small,  irregular  lateral  oscillation  with  frequency  compo¬ 
nents  up  to  100  Hz  and  an  amplitude  equivalent  to  a  few  foveal  cone 
diameters.  Microsaccades  are  small,  fast,  conjugate  flicks,  taking  some 
20  msec  and  moving  the  eyes  a  few  minutes  of  arc.  Between  microsaccades 
the  eyes  drift  haphazardly  at  about  5  min  of  arc/sec,  with  tremor 
superimposed  on  the  drifting  motion.  The  two  eyes  drift  independently 
and  probably  also  undergo  tremor  independently,  and  so  these  movanents 
have  usually  been  attributed  to  unavoidable  residual  instability  in  the 
oculomotor  system."  (p.  224) 


We  are  most  concerned  with  the  dynamics  of  large  eye  movements  that 
occur  as  the  pilot  scans  displays  and  the  visual  scene  outside  the  crew 
station.  Two-stage  models  of  visual  perception  hold  that  events  of  interest 
are  located  initially  via  peripheral  vision;  this  leads  to  fixation  and, 
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therefore,  more  detailed  analysis.  Many  Investigators  believe  that  fixation 

implies  attention.  However,  the  relationships  between  the  velocity  and  the 
amplitude  (angular  distance)  of  saccadic  eye  movements  may  provide  additional 
insights  concerning  fluctuations  in  attentiveness  or  in  decision  strategy 
(Stern,  1978).  Equally  as  important  in  this  regard  are  temporal  parameters, 
such  as  fixation  duration  (dwell  time),  since  unusually  long  or  short  fix¬ 
ation  pauses  may  reflect  periods  in  which  visual  information  is  not  beir^ 
processed. 

Young  and  Sheena  (  1975  )  have  surveyed  most  of  the  procedures  for  meas¬ 
uring  eye  movements  and  eye  position  within  the  laboratory.  Unfortunately,  a 
major  shortcoming  of  many  measurement  techniques  is  that  they  require  varying 
degrees  of  head  stabilization  to  achieve  accurate  determinations  of  eye 
position.  This  obviously  limits  their  usefulness  in  operational  crew  sta¬ 
tions.  Thus,  it  is  noteworthy  that  the  military  has  developed  procedures  for 
transmitting  head  position  (and,  in  an  indirect  manner,  1 i ne-of-si ght ) 
coordinates  to  create  a  close  coupling  of  the  pilot  with  aircraft  subsystems 
from  a  control  standpoint. 

Furness  (in  press)  has  reviewed  several  methods  for  deriving  line-of- 
sight  data  in  the  cockpit  to  facilitate  the  aiming  of  weapons,  the  designa¬ 
tion  of  ground  targets,  or  the  activation  of  control  surfaces.  One  system 
which  has  been  developed  incorporates  a  tightly  fitted  helmet  and  a  parabolic 
visor.  A  gunsight  reticle  is  projected  via  an  optical  assembly  onto  the 
center  of  the  visor.  The  reticle  appears  as  a  10  mil  ring  within  a  50  mil 
ring  and  is  collimated.  Two  lead  sulfide  photodiodes  are  located  on  each 
side  of  the  helmet,  and,  of  course,  their  positions  are  constant  with  respect 
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to  the  position  of  the  reticle.  In  principle,  as  the  crew  member  moves  his 

head  and  superimposes  the  reticle  over  a  target  of  interest,  the  relative 
positions  of  these  two  photodiodes  are  measured  and  translated  into  line-of- 
s  i  y  hi  t  information.  To  accomplish  this,  an  infrared  scanning  device  is 
located  behind  the  crew  member  on  the  canopy  rail.  It  generates  two  parallel 
planes  of  infrared  light  that  rotate  throughout  t lie  cockpit  and  illuminate 
the  two  photodiodes.  The  signals  from  the  photodiodes  and  the  timing  signals 
from  the  scanner  are  transmitted  to  a  special -purpose  digital  computer.  The 
computer  determines  the  positions  of  the  photodiodes  in  three-dimensional 
space  and  resolves  the  resultant  vector  into  azimuth  and  elevation  angles. 
Once  relative  azimuth  and  elevation  coordinates  are  knov/n,  they  are  combined 
with  information  about  aircraft  boresight  to  specify,  in  an  absolute  sense, 
precisely  where  the  crew  member  is  aiming  his  head  (and  thus  directing  his 
gaze ). 


El  ectro-ocul  ographic  (EOG)  and,  to  a  lesser  extent,  oculometer  tech¬ 
niques  permit  the  recording  of  eye  movements  without  placing  restraints  on 
allowable  head  movements.  Merchant  (in  press)  has  recently  described  the 
development  of  a  helmet-mounted  ocul  ometer,  the  design  of  which  is  based  on 
the  visor-projected  reticle  system  used  to  infer  1  i ne-of-sight  in  the  cock¬ 
pit.  In  this  adaptation,  the  reticle  generator  on  the  side  of  the  helmet  is 
replaced  with  miniaturized  versions  of  the  oculometer  sensor  and  the  infrared 
illumination  source.  The  latter  projects  light  rays  off  the  parabolic  visor, 
while  the  former  views  a  reflected  image  of  the  eye.  Not  only  can  the  dynam¬ 
ics  of  1  arge  eye  movements  be  studied  in  this  manner,  but  eye  position  can  be 
determined  directly  by  measurement  of  the  distance  between  the  corneal  reflec¬ 
tion  (of  the  light  rays  from  the  illumination  source)  and  the  pupil  center. 
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6.3  BIOCYBERNETIC  APPLICATIONS 


Our  premise  has  been  that  system  effectiveness  can  be  improved  drama¬ 
tically  if  the  central  computer  is  made  aware  of  momentary  shifts  in  operator 
status.  In  addition  to  monitoring  transient  aspects  of  cognitive  function, 
we  also  believe  it  worthwhile  to  assess  more  long  term  or  general  status,  as 
influenced  by  such  factors  as  fatigue,  anxiety,  and  physical  well-being. 

The  previous  subsection  (6.2)  documented  that  mental  activities  are 
indeed  manifest  in  a  variety  of  biological  signals.  Subsequent  to  computer 
analysis  of  the  informational  content  (both  phasic  and  tonic)  of  these 
signals,  we  suggested  that  it  would  be  possible  to  unburden  or  assist  the 
pilot  through: 

o  redistribution  of  task  responsibilities  by  effecting  greater  automa¬ 
tion  of  certain  housekeeping  functions, 

o  reduction  in  the  complexity  of  information  displays,  especially  the 
HUD, 

o  cues  for  the  pilot  to  attend  to  critical  flight,  weapons,  and  target 
data , 

o  presentation  of  adaptive  decision  aids  which  recommend  mission-related 
strategies  for  fire  control  functions, 

o  recall  of  checklist  items, 

o  more  optimal  adjustments  of  the  physical  characteristics  (e.g., 
contrast,  focus,  etc.)  of  imagery  and  symbolic  displays. 
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Moreover,  we  noted  that  (a)  pattern  analysis  of  brain  electrical  activity 

associateu  with  either  distinct  "thought"  commands  or  the  intent  to  initiate 
movement  and  (b)  eye  position  sensing,  provided  separate  means  of  augmenting 
(especially  in  terms  of  speed)  manually  operated  and  voice  actuated  controls. 

Figure  6.25  presents  the  biological  signals  listed  earlier  in  Figure 
6.18,  but  now  links  them  to  specific  applications.  With  respect  to  electro- 
encephal  ographic  activity,  we  presume  that  distinctive  features  are  sensitive 
to  continual  as  well  as  sudden  cognitive  demands.  Remember  that  "features" 
refer  to  energy  distributions  within  restricted  frequency  bands  and  to 
possible  asymmetries  in  these  distributions  across  standard  recording  sites. 
Other  features  of  EEG  activity  may  emerge  as  trained  pilots  "think"  particular 
commands,  thereby  creating  the  necessary  inputs  to  initiate  and  guide  control 
actions.  As  evident  from  the  figure  and  the  text  of  Subsection  6.2,  exogenous 
and  endogenous  components  of  event-related  potentials  are  also  valuable 
sources  of  pilot  information.  For  example,  by  referencing  the  time  course, 
amplitude,  and  locus  of  maximal  response  for  exogenous  components  of  visual 
ERPs  (since  each  of  these  attributes  change  as  image  quality  and  contrast  are 
manipulated  (cf.  Gomer  and  Bish,  1978)),  display  settings  can  be  adjusted 
automatically  to  achieve  criterion  levels  of  display  performance.  Regan  (in 
press)  recently  has  proposed  such  a  "feedback  loop"  for  a  form  of  exoge¬ 
nous  activity  labelled  steady-state. 

Returning  to  Figure  6.25,  the  suggested  applications  for  endogenous 
components  of  ERPs  require  no  further  explanation.  However,  we  should  review 
the  information-bearing  properties  of  the  different  types  of  peripheral 
activity,  as  well  as  some  of  the  headings  we  have  employed  to  depict  their 
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usage.  Previously,  we  described  psychophys i ol ogi cal  activity  in  three 

response  systems  that  have  been  monitored  extensively  to  assess  tension  and 
physical  effort,  particularly  following  the  onset  of  stress.  Therefore,  we 
have  grouped  these  response  systems  together  and  assumed  that  the  principal 
virtue  of  recording  from  them  will  be  to  denote  changes  in  "physical  status." 
Again,  sustained  increases  in  the  behavior  of  these  response  systems,  if 
caused  by  prolonged  exposure  to  stress,  should  forewarn  an  imminent  deter¬ 
ioration  in  pilot  proficiency.  Finally,  the  dynamics  of  eye  movements 
(i.e.,  timing,  velocity,  and  pattern)  should  serve  as  an  additional  indica¬ 
tion  of  the  effectiveness  with  which  a  pilot  extracts  and  processes  displayed 
information. 

In  taking  the  process  to  its  logical  conclusion,  Figures  6.26  through 
6.38  present  biocybernetic  applications  as  a  function  of  individual  pilot 
tasks.  These  are  tasks  which  occur  within  the  various  segments  of  the  escort 
mission  we  described  before  in  Subsection  6.1.  For  each  of  the  tasks  which 
must  be  performed,  we  have  indicated  whether  we  are  seeking  status  inform¬ 
ation  of  some  sort,  or  whether  we  intend  to  supplement  conventional  methods 
of  control  system  activation. 

We  recommended  earlier  that  biocybernetic  applications  be  restricted  to 
those  pilot  tasks  which  are  very  difficult,  are  critical  to  the  success  of 
the  mission,  or  occur  during  periods  of  heavy  workload.  Whereas  the  original 
task  listings  in  Figures  6.6  through  6.17  are  quite  complete,  we  now  have 
eliminated  less  essential  tasks  (with  respect  to  difficulty,  criticality,  or 
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workload  considerations)  in  constructing  the  bi ocybernetic  matrices  which 

follow.  Moreover,  to  avoid  unnecessary  redundancy  in  the  format  of  succes¬ 
sive  figures,  we  show  just  those  tasks  which  have  not  appeared  in  any  of  the 
preceding  matrices  (starting  with  Figure  6.26).  For  example,  although  the 
pilot  must  determine  altitude  during  launch  as  well  as  climb,  this  task  is 
entered  as  a  row  heading  only  in  the  matrix  devoted  to  launch. 
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7.0  CONCLUSIONS  AND  RECOMMENDATIONS 


In  proposing  to  add  a  communication  channel  from  the  pilot  to  the 
central  computer,  we  have  shown  that  electrophysiological  measures  are 
relatable  to  pilot  status  and,  ultimately,  to  performance.  Further,  we  have 
made  the  distinction  between  the  long  term  changes  in  cognitive  function  that 
occur  across  the  mission,  and  the  more  transient  aspects  of  information 
processing  and  decision-making  which  are  associated  with  specific  pilot 
tasks.  As  McCallum  (in  press)  notes,  however,  it  has  not  been  determined 
whether  a  single  physiological  measure  can  serve  as  a  reliable  index  of 
operator  status,  or,  rather,  if  several  response  systems  must  be  monitored 
to  reveal  operator  states  which  may  threaten  performance.  This  issue  of 
single  vs.  multiple  inputs  also  must  be  resolved  in  deciding  upon  the  most 
effective  means  of  augmenting  conventional  methods  of  control  activation. 

We  did  not  rank  the  various  mission  segments  when  suggesting  biocyber- 
netic  applications  in  the  last  subsection.  A  ranking  could  have  been  made 
dependent  upon  the  relative  importance  of  each  mission  segment,  either  with 
respect  to  the  overall  mission  objectives  or  with  regard  to  survivability. 
Clearly,  if  we  were  forced  to  be  selective  (perhaps  due  to  cost/benefit 
considerations)  in  applying  bi ocybernetic  techniques,  we  would  choose  those 
mission  segments  or  requirements  for  which  the  pilot  is  especially  vulnerable 
and  both  the  accuracy  and  speed  of  performance  are  critical.  In  reviewing 
the  in-flight  mission  requirements  presented  in  Section  4,  we  find  that  the 
following,  which  occur  during  air-to-air  or  air-to-ground  engagements,  place 
the  greatest  demands  on  the  pilot: 
o  penetration 
o  threat  warning 
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o  detection 

o  location 
o  identification 
o  decision 
o  execution 
o  assessment 

The  principal  tasks  which  must  be  accomplished  within  these  mission  require¬ 
ments  may  collectively  be  termed  fire  control  functions.  That  is,  we  are 
concerned  with  the  pilot's  ability  to  establish  correct  range,  azimuth, 
elevation,  and/or  FOV  coordinates  for  the  sensors  used  during  the  target 
acquisition  process.  Moreover,  we  are  concerned  with  his  ability  to  interpret 
multisensor  imagery  and  to  select  laser/EO  designators  and,  if  necessary, 
countermeasures.  Then,  if  we  assume  that  appropriate  range  and/or  velocity 
considerations  have  been  taken  into  account  in  choosing  the  weapon,  that 
arming  has  been  accomplished  prior  to  the  engagement,  and  that  the  actual 
time  of  release  is  computed  automatical ly ,  we  are  concerned  with  the  pilot's 
ability  to  maneuver  the  aircraft  so  that  the  target  is  positioned  within  the 
missile  launch  or  gun  envelope.  Superimposed  upon  these  responsibil ities  is 
a  general  accountability  for  flight  control,  navigation,  communications, 
subsystems  monitoring,  and,  especially,  threat  detection/evasion. 

As  the  pilot  participates  in  fire  control  functions  not  managed  directly 
by  the  computer,  our  principal  information  needs  are  related  to  momentary 
fluctuations  in  the  pilot's  capacity  to  process  information  and  reach  deci¬ 
sions.  If  real-time  measures  of  pilot  status  are  available,  computer  graphic 
techniques  can  be  called  upon  to  create  pictorial  and  symbolic  displays  with 
sufficient  detail  to  lead  the  pilot  through  changing  tactical  situations  and 
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weapons  procedures.  These  decision  aids  will  enable  the  pilot  to  adopt 

strategies  for  action  which  are  in  accordance  with  the  current  posture  of  the 
mission. 

Most  of  the  el  ectrophysiological  studies  we  cited  earlier  took  place  in 
university  1 aboratories,  and  the  task  demands  imposed  upon  the  subjects  were 
somewhat  constrained  from  an  operational  point  of  view.  It  is  apparent  that 
the  progression  of  a  program  which  considers  electrophysiological  signals  as 
input  to  adaptive  military  systems  will  require  that  investigations  be 
extended  to  appropriate  part-task  and  full-mission  simulations.  Thus,  we 
presently  are  conducting  part-task  flight  simulations  in  which  we  have 
challenged  the  pilot's  ability  to  make  multiple  decisions  within  short 
periods  of  time.  Our  intent  in  these  investigations  is  to  further  define 
the  features  of  brain  electrical  activity  and  eye  behavior  which,  when 
analyzed  on-line  during  the  simulation,  may  forewarm  imminent  deteriorations 
in  pilot  performance. 

Finally,  we  should  note  that  biocybernetic  applications  are,  in  fact, 

being  addressed  by  the  military  laboratories  (cf.  O'Donnell  and  Hartman,  in 

press).  Reising  (in  press),  of  the  Air  Force  Flight  Dynamics  Laboratory, 

has  predicted  that  techniques  which  yield  pilot  status  information  will  be 

an  essential  component  of  adaptive  crew  stations  in  the  future.  Moreover, 

pattern  analysis  of  "thought"-related  EEG  activity  for  control  purposes  has 

been  discussed  recently  by  scientists  from  the  Air  Force  Aerospace  Medical 

Research  Laboratory  (Aviation  Week  and  Space  Technology,  Vol.  110,  Number  5, 

1979,  pp.  239-243  ),  It  would  seem  that  the  high-risk  program  sponsored  by 

DARPA  over  the  past  several  years  may  significantl;  influence  R&D  activities 

within  the  military  and  aerospace  industries. 
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